Yes, this is a good phrase to use.
'I had some discipline trouble with my pupils at first, but now they're growing on me.'
One word of advice : make sure that you get the stress right in the phrase. You need to stress the word 'growing' , but not 'on'. If you stress 'on' it will sound very strange indeed.