I wonder if it depends on where you're from. In Britain I've never heard the phrase "rugged hands". People would say "rough", "dry" etc. but "rugged" is almost only ever used to describe faces.

Yes both terms sound natural. You can say rugged hands, especially if its from manual labor and lifting weight.