"Ladies man" has several shades of meaning. It can be a man who is very popular with women, or a man who simply likes being around women. But "notorious" gives it a negative connotation, a man who is a player or womanizer.