Lord Haart and how to get rid of him!?

How can I prevent Lord Haart (with the Estate specialty) from appearing when building a map in castles? I've already set it so that heroes can only be recruited in their home castle, there are no castles on the map, but the hero still appears. He's also not in the hero list.