More or less. "I was taken aback" is neither formal nor informal. It is literally is a reference to ships and sailing. (Many people don't know this). To be "taken aback" means the wind suddenly changes direction, the sails are blown against the masts, and all forward motion is stopped.
So, in normal use, it means "I was so surprised that it stopped me completely." You didn't react at all for a moment. It is negative in the sense that you were expecting to move forward and were forced to stop. It's not negative in the sense of being something terrible.
"The description said that the campsite had electricity. I was taken aback when I found that my plug wouldn't fit the socket. I had to make a trip to a hardware store for an adapter."
Other ways to say it are:
"It stopped me in my tracks."
"It stopped me dead in my tracks."
"It stopped me cold."
"I was stunned" literally means you were hit on the head so hard it made you dizzy. This, too, has the idea that you couldn't think for a moment, you didn't know how to react. It can be positive or negative. "I never expected to get into that school and I'd actually forgotten I applied. I was stunned when I got the acceptance letter."
"I was blown away" is informal. The literal reference means "destroyed by an explosion." Oddly enough, yes, it is usually positive.