We're agreed that if you state the precise address, with the house number, the preposition has to be 'at':
'I live at 67 New Street.'
If you specify the street name but not the house number, you can use either 'on' or 'at'.
I live on New Street ( American English)
I live in New Street (British English)