It means that you thought it through and decided it was a bad idea. Ex: I was going to hitch-hike the rest of the way, but I thought better of it. You changed your mind and decided not to do what you were about to do.