Yes, it's correct. But note you would only use this inversion in fairly formal writing, or in a rather stylised type of speaking when you are in 'storytelling mode'.