I would most often say "on the corner." Example: "The man is standing on the corner by the convenience store."
However, if you are giving directions, you can say both "It is at the corner of 5th Street and Madison" or "It is on the corner of 5th Street and Madison." Either one is fine.