I'm a native speaker of English and I would say, "My chances are slim to none." I would never say, "My chance is slim to none". I don't think there is any grammatical reason for this. It is just an English expression. For your information, there is an old song, "Chances Are", by Nat King Cole. Note that I would say, however, "I don't have a chance."