"Where are you from?" is a question about your nationality. So if you know that someone is from Germany and you want to know where exactly (what city/town) that person lives in you should say "Where do you live in Germany?"

If your question is meant to ask where specifically in Germany, then I would move the prepositional phrase. Where in Germany are you from? Or what part of Germany do you come from?

Thank you.