"of" structures are relatively rare.
We would almost always say *"My book."*.
In general, possessive structures like "my book, your book, his book, her book, our book, their book, Bob's book, the fat man's book, etc" will be much, much, much more common than "the book of Bob."