As a verb they mean the same. Leave came to English from Old English or Germanic. Exit came to English from Latin. As a noun though they are different. Exit can refer to the doorway. Leave can mean "permission to be away".

As verbs, "exit" is more formal than "leave." "Exit" can also be a noun.