In addition to the other answers, I would add "have" in the sentence.
"I have never left the library, not even for one day."
If you'd prefer to not use that word, I would change "left" to "leave".
"I never leave the library, not even for one day."
As others have said, this is a bit strange sounding as you are effectively saying you literally live in the library and do not leave.
"I never skip going to the library each day" or "I have never skipped going to the library every day" may better convey what you're trying to say.