'A factory' is a building in which manufacturing is done. 'To manufacture' is the action of making or processing raw materials into finished products usually by means of a large scale industrial operation or with industrial machines.

factory = a noun manufacture- a verb