You can simply say "I'm not peeking", or "I'm not peeking at the book".

Not really. This doesn't sound natural. I think this is because 'peek' describes a particular way of looking - quickly, and possibly guiltily, like a child cheating at a game of hide-and-seek - while the point you are making here is that you DIDN'T look at the book.