Hello!
Both "last night" and "yesterday" are used to express past tense.
But you don't say yesterday night coz it is wrong. You say "last night"
You can use "yesterday" like yesterday morning and yesterday afternoon but not yesterday night coz you will use "last night" for that.