Depends on what you're implying. if you mean that out of your love for someone you're going mad, you'd probably say "You drive me insane." If it's out of annoyance you'd say, "You drive me crazy." If you say it out of hate, you'll probably say "You drive me mad.", but you're more likely to just say, "I HATE YOU" haha