Yes, it's common. "game in town" is also common too. You can be creative and use any noun "in town" which makes sense. I have never seen "the only horse in town" probably because "horse" is not normally used metaphorically to describe a person.