The mandatory 2nd level actually balances the castles. Necropolis, Dungeon, and Rampart need it the least, and these are 3 strong castles.
2) Even with the second level, it's risky to pair Castle, Barbarian, Swamp, and especially Tower with them.
PS Not as an argument, but as food for thought...