For the general learner, let's confine this explanation to the use of these two words as uncountable nouns.
If so, then "ornament" is a subset of "decoration".
Example: The interior decoration of the college dining hall was much enhanced by heraldic ornament.