To be honest, I usually level up only one hero. However, I don't agree that there won't be enough troops for the second hero: capturing the first city will fix this situation. And there's mentorship to help the secondary hero gain a lot of experience.
There are many other clever combinations you can come up with: through direct hero attacks, or through certain unit features. You don't need to use the entire army very often.

Барон "Vampires"
Отдай свои прошлые сны,
В сомненьях себя обрети,
В бешеном танце душа кружится!
Не думай, что будет потом,
Здесь и сейчас мы живем,
Стань хоть на миг сам собой, слышишь!