The word 'talk' is often used in the context of a conversation with other people, that's why it makes more sense to say "Let's talk about this particular subject". 'Speak' is often used to describe the action of communication, and this can sometimes imply a one-sided dialogue (e.g. I am going to speak to her").

Let's talk about is used more often. I never heard someone using lets speak about.