The most annoying thing is spending 2 days hunting down enemy hero scouts.
Day 1 - Landing
Day 1 - Capturing the main castle and immediately capturing all the others (in the final version, I was 2 squares short of capturing the barbarian castle).
Day 1 - Eliminating the messengers.
By the way, if you don't clear your quarter for resources, the computer will refuse to build the 5th level of the guild.
Just a small correction: in the first game, I think the maximum is 4 levels. Back then, they didn't know how to build skyscrapers yet. :)
Regarding the duel with Phoenixes.
It all depends on your second player and their result. I did poorly, but I didn't have much time.