Yeah. Without the Orb and Robe, offensive magic deals with both demons and skeletons. Therefore, it's advisable to use either antimagic or your own offensive spells against a stack of demons.
Overall, the build is more suited for mages than for demons, which is also good in my opinion.
Auto-translated