I think the answer is that “that” is a relative pronoun that introduces the relative clause “you’ll let your parents down.” Relative clauses provide detail/explanation about the preceding part of the sentence. Another example: “I’m happy that I got a promotion.” Sometimes, the “that” is omitted in such sentences: “I’m happy I got a promotion.” The meaning is the same either way.