Since this is a countable use of the noun "time", technically the rules of grammar state that you need the article. But in real life, they're both heard frequently. So I would say you only need to be sure to include the article in formal written communication or in very formal speech. Otherwise, just use whichever you're more comfortable with.