You can use either.
If you are still hoping that an invitation might arrive, you might say 'I haven't been invited' (yet). If you are sure that this won't happen now, you'd say 'I wasn't invited'.
However, in this situation they have the same meaning. I'd probably use the second.