i think that depends the circumstance of the particular case...if you plan to go for a picnic with your family, and you wanna to take a hat to shelter from the sun but you forgot that...then your family members would be curious about that and ask you, did you forget to bring (带)with you? but gernally speaking, we only use 戴 in daily life speaking, like you used to have a hat with you, but today you dont have one... then your collegue would probably ask you , did you forget to wear a hat? 你忘了戴帽子吗?