"They live a hard/difficult life" - yes, this would probably be understood to mean they are poor
"They live a happy life" - the opposite would be "they live a sad life", there's no strong connection to money. If you want to mean they are not poor, you can say "they live a [financially] stable life"