The context which Eliot mentions has to do with how important that apple is to the present moment.
If someone took your apple, it means you don't have an apple.
If someone has taken your apple, it means you have nothing for lunch (ie. the past affects the present).
So yes, both are correct. If in doubt, start with simple past and see if that gives you all the information you need. :)