On the street can also mean by the side of the stree, or simply "in public" (word on the street). In the street always means literally in the part of the street where cars drive. Similar idea with the park.. usually we say "in the park," but a building next to the park would be "on the park". "You can ride a bike in parks and squares." -- Your sentence is correct.