There, it will either be blue or orange. If you remove heroes, something changes in the mechanics, and they jump through the portals normally during that turn.
On the map with permanent portals, the computer takes too long to make its move: for example, it doesn't take 1-3 seconds with the map closed, but 10-15 seconds.