In a polyandric scenario, you might hear "my husbands have drifted off to sleep." Note how the word "husbands" is plural, and it agrees with "have". "They have" "it, or he, has".
If it was "husbands" then it sounds like she's finally going to get some peace and quiet.