If I had more of the text, I would be sure but from the sample he is thinking about her but not in a kind way. He says he isn't thinking about the good times, so he could be thinking about the bad times. He isn't thinking of warm feelings, and the opposite of warm is cold. Generally we would consider positive feelings like love and happiness to be warm. I hope that helped.