You can't say: " I will be back a little bit." but you can say: "I will be back IN a bit." It means I'll be back soon.

It's common to say "I'll be back in a while/ a moment or I'll be back shortly"