In the US, "taking dinner" would not make sense. Most common would be: "Do not call me at the usual time tomorrow evening. I will be having dinner." Or "I will be eating dinner" or "That is when I eat dinner" would also work.

Hi there! In my opinion, this would sound the best: Do not call me at the usual time tomorrow evening, I will be having my dinner.