Either "on the third morning" or "on the morning of the third day." I would use the second one, but the first is correct too.

In the morning on the third day Or, you can say "on the third morning"

On the third day, during the morning , we pulled down out tents.