There is no difference in meaning.
Some might say "yes" is more formal, but I would personally use "yeah" even in formal company, or speaking on TV.
Listen lots to the way people around you speak to decide which you would rather use, but both are the same really.