Are you perhaps playing on Recruit difficulty? If so, that explains everything; the AI doesn't put up much of a fight.
Also, I've noticed that the AI doesn't attack a Castle if the garrison is three times weaker than its own army. It runs to the Castle, buys one reinforcement, and then starts retreating.