What phrase sound more,, natural,,?

Being late is pulling me down professionally

Being late is holding me back professionally