Off Season, but never Off Time.

"Off time" is not a common phrase. It is more commonly "downtime". "Time off" is usually used in the context of work, it means days that you are not required to work.