It's fine as it is; when will you get to play with such power again? I captured two castles, and the opponent encountered a similar army once and won. We'll see what happens next.
You can enable other factions before starting. Otherwise, it's not very interesting to play like this.