The sentence is fine. If you are meeting with someone else, and it is not a group meeting, you could say "I'm calling to remind you about our dinner tonight".

I'm just calling to remind you of the dinner tonight. or I just called to remind you of the dinner tonight.