Yes, you need an article. Without it, I hear a name: Jim.
"Are you going to the gym tomorrow?" We use the specific "the" because we assume the person will go to the same gym that they usually go to. If you write, "are you going to a gym tomorrow?", it means that neither of you know which gym, plus that this may be their first ever visit to a gym.