If you view him in this way, feel free to say 'husband'. Your relationship is not less than that of a couple who have signed a piece of paper. Also, the exact details of your relationship are nobody's business but yours. Of course, for legal or official purposes, you should not say 'husband'. But in social situations, go ahead.