Even native speakers sometimes speak with the wrong grammar. or Even native speakers sometimes use the wrong grammar. or Even native speakers sometimes use grammar incorrectly.

I agree with Kim.

"with", but "Even native speakers sometimes use incorrect grammar" is a lot more natural.

"with" is correct. However it would be more natural to say " even native speakers sometimes USE wrong grammar"