Good question.
You can say this both ways:
"I looked out into the darkness" (Here, "the darkness" is considered a thing, so the article 'the' makes sense.)
or
"I looked out into darkness" (this sounds poetic, so maybe it is not good for every situation.)
Good luck!