Neither. It means a long way down, i.e. underneath the point of view of the speaker. E.g. "the valley is far down from here". Or it may be figurative: "sales are far down from this time last year".