The phrase is grammatically correct if you use it right. Ex: There were only a moderate number of people during the lunch rush. That sentence indicates that, normally, there would be many people at a certain time. But, for whatever reason, there were only a "moderate" number of people. It means exactly what you want it to. :)