Yeah, the paper for scrolls was specially dyed yellow. The scrolls were pale yellow or white!
But over centuries and millennia, paper loses its white color and turns yellow. That's the case everywhere. Just look at Might and Magic 7, 8 - the pages in the spellbook aren't snow-white.