It's a good question, because they are all used in similar ways. They all refer to a part of a whole organisation. Generally, a unit is smaller than a department or division but there is no rule. Sometimes a divisions is divided into departments and sometimes it's the other way round. Sometimes there is a division in one organisation and the comparable group in a similar organisation is called a unit or department. It depends on the choice of words by the institution or organisation.