To be honest, I usually level up only one hero. However, I don't agree that there won't be enough troops for the second hero: capturing the first city will fix this situation. And there's mentorship to help the secondary hero gain a lot of experience.
There are many other clever combinations you can come up with: through direct hero attacks, or through certain unit features. You don't need to use the entire army very often.
