I agree. If you spend a day building a Great building in your castle instead of another, higher-level dwelling or economic building, it should be very well justified (it's better to build Succubi than a Great building for Demons), otherwise, your development will be slowed down. As a rule, in such cases, a Great building for Scouts, Beasts, or Centaurs is justified... for Demons, it's only the Hellhounds...
Bow down and hear our cry,
Our earthly rulers falter,
Our people drift and die,
The walls of gold entomb us,
The swords of scorn divide,
Take not thy thunder from us,
Take away our pride.
G.K. Chesterton: English Hymnal