One for all and all for one - 2

Am I missing something? On the mini-map, the castles are chosen differently from the starting ones. And if the starting castles are random, how do you avoid duplicates?