It refers to people who live in the same building, in apartments or rooms across the hall from each other. The speaker wants a closer relationship, not just a casual neighborly relationship.