when you say "I don't have anything to do with..." it means that you're not involved with something or someone.
ex: "I don't have anything to do with that incident" = "I'm not involved with that incident."
however, "I don't have anything to do with you." could mean: "I don't have any business / connections with you." or in a rude manner, "I don't care about you."
:)