"Went out" usually means that the overall power supply within a building or area, or that the light bulb "burned out" (failed). "Went off" means the lights were intentionally turned off. However, you will find situations where either can mean that the lights are no longer on, regardless of reason.

You would say the lights went out. (You're talking about a power outage right?)