It's better to use "place".

Place is much more common, usually, you would use place and not site. Site is used, for instance, when talking about a construction site. I can't think of any other examples. If you had specific examples, it would be easier to refer to.