They both sound natural! :)
To me, "swimming" and "reading" sound like names of hobbies, while "to swim" and "to read" would refer more to the actions (like maybe you think the action of swimming is fun, but you don't swim regularly as a hobby)
However, you can also say "I like to swim" when talking about your hobby and you can say "I like swimming" when you are talking about the act of swimming. In this case, overall, word choice is far less important than the context of conversation!