Yes, and you also need to add an “a” in your sentence, so that it reads “He was suspected of having a urinary tract infection.” It is an odd topic if you’re not in medical school, but your writing sounds pretty natural to me:).

If you don't include HAVING, it makes it sound like he was suspected of committing the crime of urinary infiection, i.e. he made the infection happen.