Here are different ways to write the sentence:
“Les contribuables sont énervés/contrariés à cause de la hausse d’impôts.”
“Les contribuables sont énervés/contrariés par la hausse d’impôts.”
Note that I said “d’impôts”, which is in the plural form because it is more natural to say it this way; however, “de l’impôt” is correct, as well (without the “s”), and it mentions that one particular tax has been risen.
Hope that helps.