Yes, you could use that idiom. It would sound more natural in the present perfect tense (because it has an effect in the present - you can't remember the word!): 'Oh, I know the word, but it has slipped my mind.'