It's not the fault of people if something scares you. They have their own reasons not to interact much with you, with other people or with the world in general.
They may be shy, or socialy awkward, or have there internal life which never bores them, even if they are alone. They may not need randome people to talk about random topics, because they just don't have a need to feel the other people presence all the time. They may not share what they did last weekend or last night, because they may have attended the past life regression class, and if you are their boss with very rational mind, they would never tell you in order not to make problems at work. Some people may not be interested in life at all like they are living, but not are being present entirely in this world. Things going inside them interest them more, than what is going around. Some people never live for full here, because they feel they don't belong this place. They feel like they were forced the be here, and that their real home is in the better world. You can't get much social activity and communication from them, because they don't see the point of it.
I've met people who don't like people, because they reckon people make our planet worse, they litter, use too many natural resources, their amount should be reduced to keep our planet safe. That's why they love animals more than people, or they prefer to be in nature more than socialize with someone.
Whatever reason they have, it is you who is afraid of them, so it's your problem that you need to solve with yourself rather than with them. Sorry, if it's rude. But everything that scares us is a thing to work hard with, but not blame other people, that they are not as we expected.