"I enjoyed your company" sounds a bit more natural, but "thanks for the company" is also fine. Notice I said "the company" and not "your company" - I think this also sounds more natural.
Also, the first part of your question should say "My friend and I went somewhere fun..."
Hope this helps!