The correct version is
“I wish [that] I had been there.”
Some native speakers add “would” for hypothetical type-2 and type-3 condition clauses and for “wish” structures. However, for an English exam or formal writing, this is an error.
If you have the well-known book English Grammar in Use by Raymond Murphy, consult Unit 41.