The person is saying that it is a joke, unless the other person is okay with that, in which case he/she is serious.

Example: "Hey, um, do you want to go see a movie with me tonight?" "Huh?" "I'm kidding! Unless you're down (interested, would like to, etc.)".