Yes, I suppose you can describe a person as "casual" "He is a casual person" Although more commonly you would hear someone say the following, "Harry is a laid back person" Or you could refer to someone as an ordinary or relaxed person. I hope this helps :)

You can say someone is a "casual person", describe yourself as casual, or even ask if someone considers themselves to be a casual person. Hope that helps out.