In my opinion, I use "in that moment" when I'm telling a story about what was currently happening in a very short time frame. I use "at that time" when I describe something more broad, like, not such a detailed story. For example:
"At that moment, a mouse appeared and I screamed."
"At that time I was just a young guy looking for a little fun."