The countable use is when you talk about conversations as individual things:
We had a conversation about the issue. (countable)
We'd already had several previous conversations about it. (countable)
The uncountable use is when you're thinking of conversation as a general concept:
Shy people often find it hard to make conversation with strangers. (uncountable)
He's skilled at the art of conversation. (uncountable)