I'll just point out one detail – there's no need to kill the poor hydras near the keymaster with the astral gates from the mage city:D
And I didn't notice any difference in the garrison sizes depending on the difficulty level.
And, yes: why is it so dark? Is the escape supposed to be at night?