"Arrive at" involves movement. You come from another place to your house. "I arrived at my house" is OK "At home" means that you are in your house now. "I am at home" Therefore there is a conflict between the two expressions so we remove the at. "I arrived home" :)

I usually arrive home late in the afternoon.

And why?

I usually arrive home late in the afternoon.