Yes, we do. Very often. And not just for the word "haben". For "machen, sehen, hören, usw." we also omit the "e". In both written and spoken German.