There are, roughly speaking, three types of non-working days:
1) weekend
2) public holiday (Christmas and so on)
3) time off
You can call both public holidays and time off holidays. You can only call time off vacation. The word "vacation" is used only in American English.