Interesting question. I think 'dormitory' is one room. If there are several of them making up one building you'd call it eg 'the dormitory building'. I could be wrong, but I've never heard the word used to describe the building itself as opposed to the room.