"have been" usually refers to something that has happened over and over, not something that happened once. "Donald Trump has been sued many times" versus "Donald Trump was sued by John Smith in 1999"
The houses were built once, so they "were built." If they had been burned down and rebult several times, they "have been rebuilt."