The Spirit of Despair only reduces positive morale to zero. It doesn't raise negative morale to zero, so it's useless with a bunch of level 7 units from different castles.
You're wrong, that's not how it works. To verify, it takes about 50 seconds, so don't be lazy and check it yourself.