Grind my gears

Yesterday, watching Family Guy, I heard the expression " Do you know what grinds my gears?"
I thought that it's like " drive me crazy" or " that thing disturbs me" but I have never heard that expression.
And yes, as <em></em>it's from a show like Family Guy, I think that maybe I need to see other shows to improve my English.

Maybe American Dad is a better choice.