If you don't capture a town, the yellow unit won't see it. So, most likely, yes, it will chase after the hero. The only thing is, it won't go into certain places, including towns.
I understand.
I was thinking about it and decided... I'll play on Veteran difficulty without the Hardcore mode.
If Ice and Fire had a linear map, then there, to a greater extent, the correct positioning in battles and development played a role.
Here, with the abundance of quests, you need to develop an optimal strategy.
I got carried away, in general, with the difficulty. First, I'll familiarize myself with the map at a leisurely pace.