The VAST majority of people draw a line at which they restrict freedom.  Total freedom would allow murder, rape, theft, and a myriad of other deeds typically deemed morally reprehensible.  Totalitarians would be on the other end of the spectrum.  Everyone in-between are simply advocating for certain levels of restriction on freedom...that's what a law is.  Any rule is a restriction on freedom.  In my opinion, yes, there can be too much freedom.  A government should protect rights and ensure defense.  A civilian's right to punch should end at another civilian's nose.

To say the least, no one should establish their freedom upon other's suffering or sacrifice which is the soul of freedom.

one man's freedom ends where another's begins

It is often taking place in my countries and most of the time we make a decision by populism which often means majority can abuse, rape minority once in a while.