yes, it's perfectly okay... just like a "make up", perfume is worn. "she's wearing a fine make up." "he's wearing a Bulgari perfume." :)

This sentence is fine. It means that you have perfume on at this moment. "I wear perfume." means that you do use perfume sometimes, but I suspect that you know that already.