It's an idiom. Imagine you're a child in school where there is a rule against chewing gum in class. You chew gum anyway. The teacher asks you if you are chewing gum. You quickly swallow it and say "no!"
So swallowing your gum means to try and hide something you've done that is against the rules.