In Britain and Australia, the object you describe is called a 'dummy'; in the USA and Canada, it's a 'pacifier'.
The word 'comforter' is used to describe a quilted bed covering in American English. As far as I know, nobody uses this word to refer to a dummy/pacifier.