It means to annoy, exasperate, or infuriate someone so much that they want to get away by crawling up the wall to get out. You could say "As a Kindergarten teacher, I usually love being around kids. But some days the kids are out of control and it drives me up the wall!"

To drive someone nuts, by being very annoying.

To irritate someone very much with one's behaviour, actions or words