For 11:50 pm, we say "Ten to midnight". For 00:30, we say "Half past midnight". Any other time, we say for example 1 am or 1 O'Clock in the morning, 2 am or 2 O'clock in the morning etc.. Collectively you can call them "the early hours"

For speakers of British English (outside of Scotland) the word 'wee' has other associations, especially when it comes to waking in the early hours... I'd say the 'early hours of the morning'.

Informally, I'd call it the wee hours of the morning. http://forum.wordreference.com/showthread.php?t=2453409