Could you give me the context the sentence was used in? Without any context this sentence, to me, means to literally tear down a home, like demolish it.

Ha ha! I'm pretty sure you mean "bring the house down". That's very colloquial. It means that a band or performer is so good that the audience cheers so loud that it could figuratively tear the place apart, bring down the walls and the ceiling from all the noise and excitement.