As background, the phrase has a literal meaning. Muscles are surrounded by fat, and trimming the fat from a piece of meat means to remove it skillfully. When I was a kid butchers did not customarily trim fat from meat unless asked. My mother always looked steaks and roasts with a layer of fat still on them. They was served on the plate with a centimeter of fat surrounding them. Some people ate the fat, some cut it off.