The phrase is "zu guter Letzt".

Karl's answer is correct, but anyway, the phrase "zu guter Letzt" does not completely resemble the meaning of "last but not least". This is because "last but not least" makes use of a play on words, which cannot be translated. For this reason, it is actually quite usual to use the original English phrase "last but not least" in (spoken, not written) German.