They're both the exact same.

They are interchangeable for the most part. The only possible difference is that 'feeble' is used more to describe an old person that has lost their strength, while 'weak' could be used to describe any person lacking strength. They can both be used to describe something lacking in substance. "That was a feeble/weak excuse." "His argument was feeble/weak."