Let me be frank. I don't think it matters, and here's why.
I have known dozens of professors, scientists, colleagues. I've known people who left Austria in World War II and had been in the United States for _forty years_ when I knew them. Many of them were much more than just "fluent." In some cases, they could speak, not just sentences, but whole paragraphs of clear, well-phrased, grammatical English--better than mine. They could understand jokes, colloquialisms, and slang. They could understand rapidly-spoken English.
But they retained their foreign accents. In some cases, heavy foreign accents. In others, slight and "charming" foreign accents.
When you listen to someone with a foreign accent, what you hear is their foreign accent. Unless you are paying close attention, or unless there is some specific giveaway in vocabulary or phrase choice, you hardly know whether they are speaking "U.S. English with a Russian accent" or "British English with a Russian accent." You just hear "English with a Russian accent."
(I know there are exceptions, foreign speakers who have such a fine "ear" that they have learned to speak "accent-free" English, and obviously I might have met them and not known it. And if you have a serious goal of speaking, not just fluent English, not just excellent English, but perfect accent-free English, then I guess it does matter).