"what I had to say" carries a little more connotation, or suggestion that you may be talking about a particular subject, especially something deep, or something long about a particular topic.
I wouldn't use the second one if it was to do with regular conversation, probably, but it definitely wouldn't be wrong to, it just sounds a little off.