Why do you leave the golems behind? Is it because of their speed?... But the spells Flight and Dimension Door are quite common in the Mage Guild at the Tower! Even with golems, it won't hinder them much.
I can understand why you wouldn't take golems - it's not necessary at the beginning of the game, and probably not in the middle either. But when you're completely clearing out enemies, golems are a serious help! You won't find better defenders for Titans and mages.