The last trip I took was to (the) Caucasus. I lost myself admiring peoples' hospitality and the surrounding natural beauty.
I guess referring to Caucasus would be much like referring to (the) Alps. People use to say they "will spend a week on the Alps", so I believe you should add the article there. Other than that, not bad :)