Then answer is "zero degrees," but I can't say I really can give a logical explanation.
The only time you use "degree" is when the number of degrees is PRECISELY 1. Zero degrees, 0.5 degrees, 1.1 degrees, one-and-a-half degrees...
No, that's not quite true. "0.1 degrees," but "one tenth of a degree."
There are situations in which "degree" means hierarchical levels of something. In this case, "degree" is always singular. He is a 30th degree Mason. He has first degree burns. The jury returned a verdict of murder in the second degree. In mathematics and the sciences, one can continue the ordinal numbers down to zero, and "zeroth" is a good dictionary word, so you could speak of a "zeroth degree polynomial," and Google is finding me references to "zero degree polynomials." I think it would be better usage to speak of a "polynomial of degree 0."