Asking why seems like a polite enough question to me. They could just as soon ignore the request.
It sounds like people are potentially open to the idea of a language exchange, but want some convincing that you're serious about it or the right fit.
Not to be rude myself, but why don't you just change your approach then, and say why in your initial message, since there seems to be a pattern here. I'm not saying you should tell them your life story right off the bat, but your reasons aren't a big secret either, right?
And believe it or not, some people are initially incredulous that you even want to try learning their language, especially if they don't think of it as that popular.