:D The damage might be less, but the enemy doesn't deal damage in return during a counterattack.
As for the "fun" aspect, that's beside the point. How you find it entertaining to mess around with the AI is your own business; I'm just describing a perfectly viable and straightforward tactic for playing the game.
It's a long tactic, and the damage from crossbows is small. I only used it on the first level of the campaign.
But you can also resurrect Vestals in the castle O_O (I used to build a different structure, but now I noticed).