It's hard to explain. I'll try:
'guilt' is a bad feeling as a result of an action that you think was wrong OR that caused someone else pain. However, if you could do it a gain, you would probably choose the same action.
'regret' is a bad feeling as a result of an action that you wish you could change. You believe that you made the wrong choice.
For example, if you break up with someone, you may feel guilty because they are in pain. However, if you think you made the right choice, you will not feel regret. IF you decide later that you made the wrong choice and should NOT have broken up with them, you will then feel regret because you made the wrong choice.