It means "I should lower my expectations", I guess.

Unless the person actually means that you should shoot a little lower. Like you are in a shooting club and you're shooting with guns and you're off the target and hitting above the target. Then you should shoot a little lower. :P