The Return, Part 2

I don't quite understand: to climb the hill to the Tear of Ash, you need to collect the Sar-Ilamm set. I think I've collected all 4 items, and they're equipped, but I can't climb the hill to the Angels.
Or do I need to defeat the Necromancers in the dungeon first?