Drive-by normally means drive-by shootings, where you shoot someone (with a gun) from inside a moving car. You can use it to describe various sorts of hit-and-run tactics though, where you're going to do something for a very short period of time and then leave immediately after.