It means, a short distance from where you are. Imagine a terraced street, houses all in one line, if the postman knocked on your door, but he had the wrong address, you could say, "oh that's Mrs Thompson, she lives a few doors down". "Few" more than one but not many "doors" = doors - properties down - in a line, left or right

Is this an idiom?