1 and 3 are both correct. 3 is different though. If you have done something you feel ashamed about, then you might feel guilty. If you were involved in an accident, though, that you thought you could have avoided, you might blame yourself. No shame there, just and accident. Don't blame yourself. Blame more or less is like accuse or assign responsibility for something that went wrong.