You do make some very good points, Tarasee, and practice is the key. I totally agree with that. However, I wouldn't want people to underestimate the importance of accents either.
You are right, native speakers are forgiving. But communication between native speakers and non-native speakers is just one side of the story. Communication between non native speakers is a whole new ball game. Non-native speakers, with time and effort, come to understand native speakers even when they themselves speak with a thick accent. But when it comes to understanding a non-native speaker for another country, it's murderously hard.
To give you a real life example, I am from India. I work in an international company with teams from all over the world. I have absolutely no problem communicating with the teams from the US or the UK. But I have an incredibly hard time understanding Japanese or Chinese people speak. That's why I have come to prefer emails over talking on the phone. That's a complaint I have heard from everyone I know who had interacted with people from other non English speaking countries.
So I believe paying attention to your accent will serve you well in the long run.