They are synonyms in nowadays Arabic (either Fusha or Accents), but In everydays life we use عندي more frequently.
But if you want to use it in rhetoric context, then:
عندي indicates possession, even if you do not have in your hand now. (Can be used if the thing is in your hand or not)
لدي indicates possessing something right now. (Only used when you have it now)