You can say both ordinary or average people but the meaning is slightly different. You can also say typical people.