"keep us company" “company" is used as a noun in this case. "accompany" is a verb, meaning (I think) 一起去。

you can also use something like dont be such a ditcher XD