Belong to' describes ownership: the blue 1963 Ford Thunderbird belongs to me, the rusty 1989 Dodge belongs to you. It's the traditional sense of 'belong'. 'Belong with' describes similarity and where something should be categorised: in a library Dickens belongs with Hardy and Austen.

belong to有所有的意思。 例：This book belongs to Brandon. 这个书是Brandon的。 belong with有相似（？similarity），切合（？appropriateness）的意思。 例：This shirt belongs with the ones on the table. （因为桌子上的衬衣相似，所以应该）桌子上置这个衬衣。 所以，有不多区别，但You belong with me和You belong to me是二者不错。