Yes. All of the interrogative words "what", "where", "why", "who", and "when" can be used in this way. In addition to asking a question, they also have the capacity to act as a placeholder for the answer to a question:
"That is what I did"
"That is where I was"
"That is why I did it"
"That is who I saw"
"That is when it happened"