Ideas and suggestions.

And there's also an issue with the specialists for level 4 castles – at the start, they have low base wisdom (except for Jedite).

This isn't a problem. Increase their wisdom, then use their starting spell. This is normal; in Heroes, there has always been a hero who can't use their spell until they level up a bit (specialist for Inferno).