In my experience, it's not natural to use "forget" here.  Native speakers would naturally say: 

"You've left your brooch in the car."

If you really wanted to use the verb "forget", you could say: 

"You forgot to take your brooch when you got out of the car."