I thought the same thing at first, but actually, everyone starts with only 1 Castle!
And he circled around the Griffons from the East - if that interests you! ;)
And looking at the number of captured Castles, I understand that everyone ends up in a similar situation! :
Sincerely,
Prorock.
And you are right about the Griffons ;)