It means that their address, their place of residence, is 4 Privet Drive.

It means Mr and Mrs Dursley live at the address called "4 Privet Drive" "it is the number on their door or a sign outside the house

It is the civic number: "4, Privet Drive"