In this case, you should say "you should have gone there". The phrase "should have" goes before a verb in the past tense (e.g. gone, been, studied), so it is correct to say "you should have been there". However, you cannot have two verbs in the past tense next to each other, so "you should have been gone there" does not work in English. Hope that helps!