I agree with Vik's idea – allow using heroes from the Dungeon without restrictions – after all, to free a level 20 or 30 hero, you need to overcome quite a strong defense.
Not only level 20 and 30 heroes are in the Dungeon, but also level 1, 5, and 10. And if you can use them without restrictions from the Dungeon... then just remove all restrictions altogether.