Hi, Julie,
The word "bat" in the phrase "right off the bat" is a baseball bat.
Therefore, the image of this phrase is a baseball being hit and flying away from the baseball bat.
When you hit a baseball with a bat, the ball tends to fly "right away" instead of staying on the bat.
Therefore, this phrase has a meaning of being "right away" or "immediately".