The first one is asking if you have gone there as a visitor or tourist
The second one is asking if you remember the experience of being inside it.
There is often not much practical difference. Theoretically you could have been inside it as a thief or employee, and not technically a visitor.