'That weirdly/rarely happens to me'. (Literally, it would be something like 'That is weird to happen to me' but I don't think this is correct at all in English.) Hope this helps!