How to win with a “weak” Knight?

You need to see which hero you're up against. If it's a mage, mass haste or antimagic are strong arguments. In a couple of months, you'll likely capture a number of villages that can be rebuilt into castles. For example, into a dragon castle or a titan castle. This way, you can reinforce the knight's troops with 1-2 more units from another castle.