The expression "in front of" means that one thing is relatively positioned before another. If there were four cars ahead of me at a traffic light, I could refer to any of them as in front of me.
Meanwhile, "in the front of" describes a fixed position related to the other objects. Thus, the first car would be in the front of the line.