If they are still relatively young, it would sound more natural to say, "I want my children to have a steady upbringing".
"Stand on solid ground" does not sound very natural/native to me. It sound to me like an idiomatic expression that one might find in a collection of idiomatic expressions, but in fact is not used "on the street", in casual conversation with friends and family, in the workplace, etc.