To refer to the location you can only say "The Caribbean Islands" or "The Caribbean". If you say "The CaribbeanS" you are then referring to the people that lived in that area. Ex. "The Caribbeans came from the Venezuela coast around the 11th century."