There's no way to achieve balance there, no matter how many tweaks you make. A well-placed external dwelling or a properly sized Griffin Conservatory more than makes up for the external market.
That's why the most principled approach here seems to be dropping bans altogether, playing by anarchic rules.