This is precisely why the concept of an "overall game concept" is needed; it allows you to provide some argumentative basis or philosophy for certain changes. So that the arguments don't turn into "I like it/don't like it," but have some objective component.
For example, as I see it, in your mind, the thoughts "sometimes you start with 10 gnolls, that's fate" and "I'm annoyed by the lack of control in the late game" coexist without contradicting each other.
But I cannot influence the presence or absence of control in the very first utopia/guild/scroll, and I can't restart! This is simply a pure factor of luck, a fundamental and important factor on large maps, which is what is being proposed to smooth out!