When the "gloves come off" it refers to now it's for real, no rules, etc.....Boxing gloves provide a cushion whereas in the old days, 19 Century, they would fight bare knuckles. The saying came about in the early 20th Century when the gloves became introduced. So when somebody tells you "the gloves are off" they mean business. No messing around. No cushion. Hope that helps.