Exactly: the height from the ground to their knees. You can read this phrase (almost) literally. If we talk about being very very young, we might say "knee-high to a grasshopper".