上司（じょうし） = Boss in business situation 親分（おやぶん） = Boss in Japanese mafia or bandit groups and it is also used in animation or childish story for fun. 親方(おやかた) = Boss at relatively small office for blue color works such as carpenters , plumbing officers ...etc.

In Japan each office position have one especific name, in formal occasion is mandatory. Others moments you can use only ボス(bosu) Ex: kakarichou, dichou, samchou ...

Let me just add something. "Boss" is very general name. You can use "bosu" to mean the highest person in a organization or a section. If you want or need to specify, there are specific names for every different kinds of bosses like the ones Edson-san and alucky-san wrote. Kakarichou, jichou, syachou, kachou, etc. are all one of the じょうしs for entry-level employees.

I have never worked under the Japanese supervision before. But, when I was assigned to wrork in Japan, some local Japanese co-workers call me ボス. It sounds like Boss.