Hello! Both work fine to get your point across, however, the second one uses "the" banker, which would indicate that you are talking about a specific banker, rather than just any banker. In which case, if you want to use the first one, you can say "What is a difficult part of a banker's job?"