I went to see my my family and we had a big lunch.
You "WENT" so it was in the past, and you "HAD", also in the past. The Big Lunch refers to a grand and wonderful amount of food.
Don't worry about grammatical details, the key to English is to Speak It correctly.
Understanding all the rules comes later.