Personally, I wouldn’t use it as you have. A: You brought a case of wine? There are only 5 of us! B: Yeah, I guess I went a little overboard. (Got too much) Seems to work well with amounts. And it often has the idea of being well-intentioned but too much. In the negative, it can relate to exaggeration. A: Game of Thrones is the best thing to ever appear on television! B: It was good, but let’s not go overboard. (Don’t exaggerate) I don’t like ‘overboard with …’ If you have to explain it, use another expression.

These sound good, Viktoria! I would just say that in number 2, you don’t necessarily need ‘with it’ after ‘overboard’ – the sentence makes sense without it. Otherwise, these are clear and make sense. :)