For the last three examples, I would assume you meant money, unless there was other context.
The first one is more obviously, emotionally.
Emotionally, I can’t afford to be with you
Emotionally, I can’t afford to stay awake much longer.
Emotionally, I can’t afford to work in this place.