Both can be used to refer to 'my house'. 저희(제) 집 sounds more formal than 우리 집. If you are talking to strangers or seniors, always use 저희 집.