Moving to the castle and capturing it are two different things. You can move around the map as you please. The main thing is not to upgrade your troops before removing the guard near the Fortress on the Hill and not to change the flag of the lower city to red before taking the Pandora's Box near the gate of the lower castle...
Let's summarize the restrictions regarding the use of angel wings:
1. You cannot "fly over"