Its not a phrase that is particularly used. But when something 'counts against' it could mean incurring some sort of penalty. Knocking over hurdles in a race might count against the time - a 5 second penalty added to the race time for each hurdle. A timed maths test might have each error counted against the time.