Not at all. Quite the opposite, in fact.
In the real world, you would generally only ask the question about whether or not John used to smoke if you know that he doesn't smoke now. For example:
"I heard that John used to smoke."
"No, that's not true at all. I've known John all my life, and I know for a fact that he's never smoked."