Yes, it's absolutely okay to say that you're counting down to August 31. Counting down to a specific date is a common way to express excitement or anticipation for an upcoming event. Whether it's a birthday, a holiday, a special occasion, or any other significant date, people often use this phrase to convey their eagerness for the day to arrive.

People also often say "I am counting the days until August 31."