'To endeavour' (verb) means to try. An endeavour (noun) is something that you do that takes a lot of effort. So to encourage someone in their endeavour is to encourage them in something that they are trying to do.