"He is not such man as would leave his work half done" is the correct phrasing.
This is very formal, however. In fact, I can't think of a situation in modern English where it would be appropriate to use this kind of language - perhaps a judge, summing up a case in a formal court of law?
In everyday modern English, we'd say something like this: "He is not the kind of man who ..." or "He is not the kind of man that..".
NB Both 'who' and 'that' would be wrong in your original sentence.