That's grammatically correct and considered polite, but like what Rye mentioned, you can add "yang" right before the word of "dingin" to emphasize that you want a cold black coffee. It's really common among Indonesians to use that form. "Yang" in English could be described as "that" or "which".