It means that it isn't fun to go to a zoo—which is mostly an outdoor experience—if it is cold/raining/snowing, etc. The weather in this case is the buzzkill—it kills the "buzz" (enjoyment) you would normally have going to the zoo. A typical example of a buzzkill is going to a party and discovering that your sister or parents are also there... .