Actually i was wrong in my first answer.
Let me quote what I found.....
A pet peeve, pet aversion or pet hate is a minor annoyance that an individual identifies as particularly irritating to them, to a greater degree than would be expected based on the experience of others.