Yes, the sentence "I usually indulged in ice cream when I was a kid" is grammatically correct and makes sense. It means that when you were a child, you frequently allowed yourself to enjoy or consume ice cream, suggesting that it was a favorite treat or something you enjoyed regularly during that time.