It means that "this thing makes someone angry or irritated." For example: "Much to her chagrin, I got the job." = She was NOT happy that I got the job.