Not at all. 'My elderly friend' would suggest that the person at least 75 years old, and that the speaker is considerably younger.
The phrase 'old friend' doesn't usually refer to the person's age. It simply means that this person has been your friend for a long time.