for dinner" ususally refers to the food. "What did you have for dinner?" to dinner" is used when you ask someone out. "Can I take you out to dinner?"

Invite to dinner means you are going out to eat. "I invited John to dinner. We are going to a fancy restaurant." Invite for dinner means you are making dinner for someone at home. "Mom invited Kate for dinner. I will be making her favorite dish."