It's grammatically correct. But it sounds much more natural to say: There are five people in my family.

To my ear,sounds lil awkward I'd prefer to use "My family consists of Whatever the number"

No, it's very abnormal. You can say: "my family consists of 5 people" or "there are 5 people in my family", the 2nd is more normal