Usually used when someone wants to relate to something that happened long ago. Picture this: A grandfather talking to his grandson who is playing on his computer. The grandfater says, "Back in those days, we don't have computers; we played with marbles all day."

"Back in the day" is a way of saying "a long time ago in your past." People can say it to refer to how the old days were when they were younger.