If a perfectly legal and doing-nobody-harm enthusiasm is negated, as a result of cruelty, for instance towards a child, it could turn into a very specific passion, named hate.
If an enthusiasm is cultivated enough, and a little bit of luck is also present, a passion could stem from that could be inspirational for a lifetime.
Passions are not always with us, sometimes they need to sleep quite often, we should not burn the funeral pyre too soon, just do our best, wait, and see.