I don't know how, but we still need to get rid of them, otherwise we won't be able to capture the city in 7 days.
We need to get rid of one archer; the rest can be taken with us. This won't affect the city capture. It's possible that visiting the mage's hut will make us run out of time, but I doubt it; I still had some movement points left.