There probably is a difference, but most people use them both the same way. It's used to explain a sentence like, "Time flies when you're having fun." because time doesn't literally fly. Anyone could say "metaphorically speaking" or "figuratively speaking" before this sentence and it would mean the same thing.