Chris Tooze is right to say that BrE speakers say both, and his other comments are helpful. For this particular sentence, I would tend to say "game" because of the alliteration (https://www.oxfordlearnersdictionaries.com/definition/english/alliteration?q=alliteration).
In informal spoken English, it would be "The players scored twenty goals a game."