The Tower's main trouble is unit speed — everyone is slow as hell. Upgrades help to some extent, but they require money, which isn't always available. Plus, the most profitable buildings are Naga banks; the Tower struggles to take everything because of that same speed issue. A speed pendant/ring really makes a difference here...

The second trouble is an unbalanced army (compared to Rampart, for example). Only Nagas and Golems can fight reasonably well, and in contact battles, it's basically only Nagas. Moreover, they should ideally be upgraded, which again means money. And they are weak in Dragon Utopia — dragons often start hitting them specifically, ignoring the same-type units.

Only Golems are good for absorbing hits; Gargoyles are poor at it, and Mages can only be taken into a serious battle if they have an external dwelling, whereas usually they are taken in a quantity of 1 pc. Giants and Djinns appear late (rarely) or do not appear at all (more often).