A flanking maneuver – without engaging Gilroen, take the town in the upper right corner and wait for him there. At the same time, avoid taking the town closest to you for as long as possible, otherwise, many elves will be born.
P.S. before fight #2 with Gilroen, you must definitely take that town
(otherwise, you'll mess up just like I did).
I understand your idea... but what about the Emerald Dragons that stand in the way to the castle in the upper right corner?