Greetings,
If you want to say something which happened early morning but is effecting our present moment then it is right.
The baby has finally come early this morning.
If you want to let someone know about the arrival then you can say-
The baby arrived/came early this morning.
Hope it would help !
Regards,
Deepika Mantra