To help you visual a "wing", imagine a hospital shaped like the letter L. It might have two wings. A hospital shaped like an X might have 4 wings.

a part of the hospital building

Google definition of "wing": a part of a large building, esp. one that projects from the main part. So, a "hospital wing" is a wing of a hospital.