"Saya" is the correct word, which pronounce "ya" at the end of the word.
In your case, hearing "ye" as the end sound, maybe is because "ye" sounds softer than pronouncing "ya". And when we spoke to the elders, we try not to speak our word in a strong way, so "ye" had somehow replace the "ya" sound. Just some of my thoughts.