In American English, we say "The audience IS annoyed at the performer's annoying words." Note that "audience" is singular here in the States, although, I have read online that "audience" is considered plural in other dialects of English. Also, we would say "The audienceS ARE annoyed at the performer's annoying words." if we were speaking about multiple audiences. For instance, the audiences at different venues throughout the United States.