Who are you referring to? Yes, it means exactly that, who are you talking about? To refer is to reference to something or someone.

https://www.grammarly.com/blog/who-vs-whom-its-not-as-complicated-as-you-might-think/ you can work it out for yourself.

yes you say who when it is about he or she and you say whom when it is about him or her "who are you referring to jack or jill" "whom are you referring to him or her"