It's a way of conducting oneself with a relaxed state of mind. "He came to the podium to give the big speech in a casual manner." Facial and body language all look very casual to people watching (even if the situation is stressful).