They are basically the same. However, you might use "cheapest" for something of lower quality and "least expensive" for something of higher quality.
The cheapest airfare. The cheapest box of cereal.
The least expensive diamond. The least expensive Ferrari.