I see it like this: if you took out "for me", saying "It's easy going..." would not be commonly correct, though people can understand you. Usually, we hear: It's easy to go somewhere It's hard to do something The infinitive --to + base verb-- is what's right to use. The same applies for when you add an object such as "me". So, saying "it's easy for me *to*" (using the infinitive after ME, not the gerung), is correct grammar. It's the way I see it as a long-term English student =)

It's the rules I guess.. on an unrelated note easygoing= relaxed and casual but there is a context where you might have heard them in close but separate sentences like: "You know what's easy ? Going somewhere far away from this nonsense!" I imagined like a soap opera type of scenario for this example. But in your case in the same sentence you have to use" It's easy for me to go.." just because that's the standard.

Because the phrase is "it is easy (for someone) to do something"

Hi Nao, I can work with you and help with your English. Please come and schedule your fist lesson. We will have fun and learn together.