"The victims were not referred to by name." = The victims names were not given.
"You know who I'm referring to." = You know who I am talking about.
In this case "referring" to somebody means talking about them or having to do with them.
If you refer something to somebody, you give it to them to be dealt with.
"I am referring this complaint to you, because this is your responsibility."