In my opinion, "I didn't bring my English book." is correct. To understand it simply, people usually say "I forgot my English book" not "I've forgotten my English book."
If you want to have a further look, it's also because the simple past tense indicates things that happened and finished. Meanwhile, present perfect tense is used for things that happened in the past and it might happen in the future. Hope it's useful for you.