No, because you want a noun or pronoun there, which "only one" is, and "single", being an adjective, isn't. (Well, there is "single" as a noun meaning an unmarried person, but that doesn't apply here.) You could however say "you are the single person ...".