Neutral creatures in Heroes of Might and Magic V.

Here's a question I have: why the hell do these neutral units defend all the mines and lumber mills so fiercely? I needed to raise level 4 units (and accumulate 60-70 level 1 units) to conquer a simple mine. Maybe they shouldn't resist so much? In Heroes 4, mines were conquered easily.