It means "you're talking nonsense".

drivel = nonsense

"Drivel" is an older word, related to the modern "dribble" (ie. saliva). So it means you are talking nonsense, ie. you'd make as much sense if you just dribbled instead.