I did the exact opposite -- I read the part about Jane as a little girl over and over, and couldn't read more than a couple of chapters of the rest for a long time. But that was coming to it as a child and not being interested in all the adults.

I skimmed the Gondal bits in Peter's Room first time through, finding them terribly dull. They've grown on me since.