Whether you use 'ma' or 'mon' is based on the gender of the word itself, not the person speaking. Famille is female (easy to remember), so you should use ma.

Yes, it is always " ma famille" becauseIt is a feminine name whatever your gender.