Ah, so it wasn't just me! I don't understand why this happens, but their foolish march south is what allows you to win this battle.
Now I'll illustrate this mechanic more vividly :)
Added 6 minutes later
https://www.youtube.com/watch?v=9_l6SOPl09Y&feature=youtu.be