Yes, you can say this.
However, for me it is more common to say "I curse the day I met him." or "I regret ever meeting him." or "I wish I had never met him." The first of these three examples is the strongest, and closest to your desired meaning.
I hope you don´t ever need to use these sentences :)