This "over" is similar to "over there". The two speakers are probably a bit far from it, like maybe they're both at home, but they both know that 3rd Ave is in the centre. The meaning is pretty similar to "It's on Third Avenue", but "It's over on..." sounds more informal.