Well, it definitely isn't due to logistics. It happened to me after standing in the castle for a while.
It's definitely not because of the castle. Since in the Inferno campaign in the first two parts, there isn't a castle at all, but the trail was still quite noticeable.