Yes, new to you. The point of the word 'new' is that you are explaining why you want to visit it, not describing previous visits. You could start by saying 'Actually there are no interesting new buildings where I live so I'm going to talk about ... which I have always wanted to visit.' Or you could talk about any famous building in the world.

I can understand your confusion, I suppose it depends on context. I would say go for a building which is new to you. But its not at all your fault... the question is a bit unclear