Please provide more details about this point. Did you go to the Elves after receiving the quest to eliminate the Orcs? What do you mean by "they won't let you into the Castle"? You just need to go to the bridge in front of the Castle, not into the Castle itself.
An army of Ents was guarding the Cloak of Silana and something else similar (like a Ring of Warning). But these are not valuable artifacts; you can buy more serious ones in the Castle...
You can get the Stone of Ancestors by defeating the Elves, which is perfect for those playing as Orcs.
I think getting 75 reputation with the Humans while playing as Orcs is quite achievable.