Hmm... I don't believe that gargoyles, even with buffing spells, will be incredibly powerful opponents in serious battles (for example, against a horde of gorgons). Okay, let's say the genies cast haste, shield, stone skin, blessing, prayer, luck, and all sorts of unnecessary elemental resistances... but gargoyles still won't become super fighters – losses are almost inevitable (although significantly reduced, of course)... if they fight powerful liches (at least a horde of them in several slots), the liches might not even pay attention to the gargoyles – they'll focus on killing the mages, gremlins, or genies, taking advantage of their low numbers... who will then provide fire support and cast spells?
There are many weak neutral units that are fast and like to attack those who are weaker (dragonflies, silver pegasi, etc.)...
Even a horde of grayed imps has considerable speed for a level 1 unit. At least 1 slot out of 5-6 of these neutral units can get a second turn and rush to one of the genies. It's not serious, of course, but it's annoying if the army is far from the city and there are no more genies to replenish the slot in the army.