It's not a secret that we live in a world where English is a must for a lot of students and workers. So when you compare the number of people learning English to any other language it's not surprising that there are far more English learners.
Therefore, when you are a native speaker of English it's more likely that you have a conversation with a non-native speaker of English. So it's harder to consider someone special just for speaking English. While when someone learns another language, which barely you will find another learner, native speakers of that language will consider you special just for that reason.
In my case, I haven't had a conversation face-to-face with someone who has learned Spanish as a second language. So I think that experience, if it happens one day, will be kind of a milestone.