It's just a little unnatural. 'minding' isn't used very much in this context these days, so it sounds a little dated.
One alternative is:
Commoner: "Thank you for not being bothered by a commoner like me" or "Thank you for caring for a commoner like me". I think the first is closest to what you were saying.
Prince: "I care for you all" or "I love you all"