I believe that We don't have a clear translation for that "drive" in the Japanese language.
However, people usualy say "イライラさせられる” which almost means "be annoyed" for "drives me crazy", or if you are saying for another sex that drives you nuts, you would say "夢中にする”.
here's some examples..
- This traffic drives me crazy every morning. => この渋滞には毎朝イライラさせられる
- There are many women at the office, but the only women who makes me nuts is Jessica
=>会社には沢山女性がいるけど、私を夢中にさせる女性はジェシカだけだ。