Poke through means to break through the surface. The sun can "poke through" the clouds. If you 'poke through' your book, to me, it means that you just opened it and are looking at some of the pages, not really reading it thoroughly.