“That would be his husband.” expresses a possibility. It means that the person saying that is not sure.
“That must be his husband.” expresses either an emphatic or a true statement. It means that the person saying that is either saying it to emphasise the statement or saying a true fact that the person knows already.
Hope that helps.