Although they can be used to mean the same thing (i.e. that someone has remembered an exciting moment from the past), the second sentence can also mean that the moment was so exciting that it is something that will be remembered in future. We would generally then add "forever" to the end of the sentence.
When talking about a memory from the past we would more generally use the first sentence.