You should say "You got me wrong". The second sentence doesn't sound natural. You can say "We don't want to get misunderstood by others". Hope it helps.

It would also make sense to say "I don't want people to get me wrong." in the same context. Also, you wouldn't use "You get me wrong", but if someone where to misunderstand what you're trying to say, you could say "You're getting it all wrong." However, this could only be used to close friends (or someone you don't really like haha) as it can come across as rude. A politer way of saying it would be just to say "That's not what I mean."

Hope that was of some help! Sorry about the comment-spam!

"Don't get me wrong" is usually used when you're about to say something you feel the other person may not understand or be upset by. For example, "Don't get me wrong, I'd love to come, but I'm just too busy."