Usually "in the" is used for location. "I'm in the store." It can also be when you're "in the" process of doing something like "I'm in the middle of eating dinner."
We say "I'm on the phone" or "I'm on the computer right now." Also, "I'm on the way" meaning I'm coming right now.