Which castle allows for the fastest development?

What do Cyclops have to do with this? I mean, building structures 1-2, 5, and 7 in the Castle. You have to take the crystals from the Dwarves...