To say something doesn't sit well with someone means that they are not comfortable with/happy about the situation. And isn't is quite correct. Perhaps you are thinking that because 'laborers' is plural, isn't should be aren't? However, it is the on-rush that isn't sitting well, so isn't is correct.