“At”: Where were you today? - I was at the waterfall. (I was at school, I was at my friend’s house, etc)
Near and by are interchangeable, but “near” is the more commonly used of the two in everyday speech. “By” (in the place of “near”) could be considered a higher register, with a more formal tone - you would see it used this way in literature, for example.
Example: I’ve been looking for you all over the park. Where were you?
- I was near/by waterfall.
In theory you could use “at” in this case as well, although “near” and “by” give the idea of proximity.