"What's more" is definitely more common, at least in the U.S. Contractions are less formal than writing the words out in their entirety. I think English spoken in the U.S. is overall, less formal than the English spoken in the U.K. (for example).