Its figurative meaning is "Let us end what we are doing for the day." Hope you like it.
Mary: Well, that's the end of the reports. Nothing else to do.
Sue: Let's call it a day.
Bob: Let's call it a day. I'm tired.
Tom: Me too. Let's get out of here.