That’s when the Towers overwhelmed me (surprisingly, 3 Towers were built, and I was only expecting one).
It’s bad that the map wasn’t explored. But before the attack, you could have at least looked at your Castle and checked the buildings. This map gives you a very well-developed Castle right from the start. :)