He is a fraud means he is pretending to be something/someone he isn't. He is a fraudster means he is carrying out a fraud. These meanings might overlap.

They mean the same thing. I prefer #1, but they are the same.