Actually they are inter-changable really, so use whichever one you feel fits better.
But for instance, I would say "Children are playing in the street", not "on the street". A person or object would usually be described as being "in the street". However, a location would be described as "on" a street: "My house is on fifth street".