"Belong with me" should be taken in the context of the other lyrics of the song. In the said song, the singer states that she's the only one who can understand the object of her affection, and on that basis, the former "belongs" to her. So in this context, "belong" means "compatible". Although there better synonyms to "compatible" in English, "belong" sounds better.