It isn't a present perfect form at all - 'to have visited' is the past form of the infinitive 'to visit'
'John was the first guest [to arrive]' means that he was the first guest who arrived.
'The first settlers [to have visited]' is a similar construction. It means 'who visited', but it's a neater expression.