The intention of the two is the same, but the second is certainly not natural. The form would generally apply to a third person, not to the second person (i.e. not to the listener). Since it is plural, furthermore, it should be 'those', and not 'that'. I have some opinions different from those of Mr. X. My opinion is different from that of Mr. X