It's technically ok to use proximity in that way. The first thing I consider when looking for a house is the proximity to my work. Another more natural way would be like: The first thing I consider when looking for a house is the distance from work.