You got everything right. So what it literally means is something like;
"We have to consider this way; once we live there, that's the city (where you are settled in / where everybody would dream of / where everybody would long for, etc.) "
Does this make sense?