We have the phrase "don't get your knickers in a twist" when we're telling someone not to overreact. Based on this meaning, you can understand your phrase as meaning "but nothing to worry(?) about too much."