From a muso point of view, "amplifier/amp" usually implies a speaker is included. For higher-quality amplifiers, you mean only the circuit to make the sound louder. So you buy the speakers separately.
For the electronic device used to create the sound, the general name is "synthesiser" (or synth).