The object of 'break up' is usually the couple themselves:
Jack and Rosa broke up.
Jack broke up with Rosa.
The object of 'break off' is usually the relationship:
Rosa broke off their engagement ( This is the usual collocation)
Jack and Rosa went out for while, but then they broke it off.