Yes. It's kinda idiom. It means 'forget easily'.
There was a long folk story. In a short.... long long long time ago, while a crow ran an errand from 염라대왕(King of Hell), he was busy to watch that people were hunting a horse. He lost to the important document in the show.
Since then, people say 까마귀 고기를 먹었냐 to a person who forget easily.