Do we know each other? It seems like we have spoken to each other before.
Do we know each other? It seems like I've spoken with you before.
If you dont add "to each other" and just use "we have spoken with you before", it gives the impression like there are many more people involved in the conversation from your end.