As an example: "That noise worries me" implies that you think the noise indicates a problem or that something bad might happen. "That noise bothers me" might mean that you're worried about the noise, or it could just mean that the noise is just loud, distracting, irritating, etc.