in your sweats = wearing your "jogging trousers" or "pyjamas" = any clothes that you wear INSIDE and wouldn't dare wear outside as they look rough/terrible/cheap etc.
So it means, "a guy who wants to show you off to the world when you are looking your worst"
It means he is proud of you, even when you think you are not fit for it