Yes, you certainly can.
Words such as beautiful, pretty, good-looking and handsome can be seen a reasonably objective assessments of someone's appearance.
By contrast, 'gorgeous' often has a more sensual connotation. For example, if you describe food as gorgeous, it smells wonderful and tastes absolutely delicious. A gorgeous dress makes you want to wear it. If it's a gorgeous day, you don't want to stay indoors - you want to go to the beach and enjoy it.
So, as Paul says, if you say that someone is gorgeous, it may suggest that you find them sexually attractive. That's why a woman, or a gay man, might describe a man as 'gorgeous', but a straight man wouldn't. Likewise, a woman can describe a baby or child as gorgeous, but it would sound very creepy if a man were to do so.