Both Steve and John omit the other possible meaning of "must have", which can also be used if you believe that, in spite of some small uncertainty, there's strong evidence that someone did it--so they "must have done it." For example:
Dick: I think Sally must have eaten the last chocolate pudding from the fridge, don't you, Jane?
Jane: She must have eaten it--just look at her mouth and hands!
If you wish to indicate uncertainty you must use a questioning tone of voice whereas a level or emphatic tone, as when stating a fact, indicates you're quite sure (based on the evidence).