Or you can choose not to take these fortifications and pass by... In general, that would be logical; you can't attack everything you see. You need to try to play "on your own terms" when you have the opportunity.
But that's not up to me; I don't know what you have in mind and how everything is arranged in your city. Maybe you don't have an alternative route. /