Indeed, the dictionary might say that the pronunciation is as you mentioned; however, as we are talking about pronunciation, it is difficult to show exactly the differences in written.
Furthermore, there are many different accents in France and some people may say those words the way the dictionary mentions them, and others, the way I explained it to you. You might even hear different sounds for those words, as I don't know all the accents in France.
In a nutshell, it's for you to pronounce the words in the way that suits you best. As long as you're comfortable, that's okay. You should still be understandable either way, and people normally don't pay to much attention to it.