However, to maximize its usefulness, it needs to be built earlier... ;) not always desirable. ;) But if necessary, you have to, otherwise you won't be able to develop the Stronghold without wood and stone.
Yes, that's true, but spending 5000 at the beginning on the Impassable terrain seems less reasonable, IMHO.