Dwells – Unique dwellings for creatures on the map, levels 4-7.

How do I change the dwelling's guard? It seems illogical to assign mages to defend a dwelling, only to have it guarded by djinns, titans, nagas, and mages.