Logically, it has to be wrong as "the past" means all time from the past to the present which is expressed by using the present perfect.

I think so (no verb) but we do say "what's done is done" which is a nice way of moving on from a problem.