Which faction poses the greatest challenge for the Dwarves?

Until their turn comes, there's a chance they won't even get to move... and the AI always tries to eliminate them.