My interpretation is that 'handicraft' is the generic term for a type of activity (singular), whereas 'handicrafts' are various (unspecified) crafts (plural) which can be taught. In daily usage, most people won't notice the difference, which makes them more or less interchangeable.