You have to play terribly badly to lose even half of the Druids.
And even in the decisive battle, they don't really matter – archers are the primary target.
No one is arguing about the old versions (without Elder Druids) – the Elves were really buffed.