Which castle is the most difficult?

Perhaps the easiest way to start playing is with Conflux, Stronghold, or Fortress:

Nah, forget it. You need the "micromanagement" skill for all these towns.

In my opinion, Rampart and Castle are the easiest. (Archers) Close them off, and shoot everyone down.