It means they have to go.

In the process of traveling to or leaving some place. We were a little late leaving the house, but we're on our way! I just want to get a drink of water, and then I'll be on my way.

“be on our way” = to leave