I think this may be a misunderstanding of what "took you to task" means. It means that the parent was upset with the son and scolded him. So, with this understanding it makes sense that the parent "took him to task" for NOT cleaning his shoes. He should have cleaned his shoes, but he did not.