A: I know this apology is overdue, but I want to say that I'm sorry for being so rude to you last week.

B: Thank you, but I wish you'd said something earlier.

This is from someone's test or textbook. I find "you had said" makes sense to me, all right, but I see lots of  "I wish you would have said something" on Google. Is the 'would' to cushion the word? Would you say that in the above context, too?