You write these words when you are unsure of what will happen.

"will he break up with her?"

"Maybe"

"Perhaps"

"Probably"

Using "probably" is a bit different. When you use "probably" you are saying that you think that it will happen. It's the same as saying: "The probability that he will break up with her is high."

when you try to designate that something could be possible or not.