The only difference is that one is singular and the other is plural. That's all!
Use the singular when there is one single interest that is shared.
For example, you say "Bill and Jack have a common interest in music" because music is a single interest that is shared by them. The fact that "music" is singular has nothing to do with it. For example, you can also say "Bill and Jack have a common interest in music and dance" even though "music and dance is plural". That's because you are still thinking of just one interest that they share: their single interest in music and dance.
However!!! You could also use plural and say
"Bill and Jack have common interests in music and dance."
Both ways of saying it are correct because you are free to think of their interest(s) in music and dance as one interest or as two interests. Choose the way that feels best to you.
You say "Clean streets are a common interest", even though "streets" is plural, because "clean streets" is a single shared interest. If you said "clean streets are common interests", it would sound strange (but not ungrammatical) because it would be odd (but not wrong) to think of each street as a separate interest.
Use the plural when there several interests.
For example, "Bill and Jack are friends because they share common interests: art, sports, and photography".