if you stay at the other end you can say "he is sitting at the far end of the table" but if you sit middle of the table you can not say at the other end.