Speck just means a small piece or dot.
"There is only a small speck of mold on the apple, so I think it's safe to eat."
"I'm still finding specks of dirt on my coat after that weekend in the country."
"Living with teenage boys means there's never a speck of food in the house."