Yes, there are plenty of ways!  "Poo-poo" sounds like baby talk, and in fact we would not even state what we want to do so directly.

Here are some example phrases: 

I need to go to the restroom/ladies/gents.

Nature calls.

Excuse me. (ie. Say this as you get up to leave the room.)