Both are correct from my understanding. "Works on a farm" for if he is actually using his tools to work/plant vegetables, or "works at a farm" if he works in a store inside a farm.

"He works on a farm" is the correct way to phrase it. Since the work occurs "on" the land which the farmer works, "on" becomes the correct answer.