Button

Any english speaker would understand what you said but there are ways to improve this. For instance, "The fourth button from the top was coming loose, so I sewed it back on. Now I can wear the cardigan again."

Or to provide you with another option you could phrase this as "One of the buttons on my cardigan was coming loose, so I sewed it back on." The fact that you can wear it again is now implied.