Memoir usually means the past. Like you are creating your memoir of something that is very important to you, like the person you love. Memory is something that you are trying to remember. Question, " How good is your memory/" It's like how well do you remember things or person, that's memory like the present time..
I hope I answered your question.