Grover’s Expedition

I can't attack Nibros when he descends into the dungeon behind me towards the portal. The red sword icon appears, but I can't attack. Skipping my turn doesn't help either; the demon doesn't attack on its own.