Well, I have two ideas about your idea.
To a very beginner, yes, maybe forgetting grammar temporarily will help you feel easy to 'open' your mouth, to make yourself 'brave';
When you speak very good English, you won't let the man who is talking to you wait you for a minute after you finish every single sentence so that you can test the sentence you just say by looking up the grammar that this sentence refers to in a grammar book.
You already have grammar in heart - it'll be so interesting translating your question into Chinese: 我应该在我讲汉语的时候忘掉汉语的语法吗?