That's a bummer :( A penalty can be issued even if there's no penalty enforcer :)
And what's noteworthy is that all heroes are penalized, regardless of whether the terrain is native to them. And also, all heroes are penalized regardless of whether we are transferring a "friendly" or "enemy" monster.