Most often students I talk to find the speaking and writing sections the most difficult. 

Being in the situation where you have to answer and respond to a fluent native speaker is a daunting a task!

Writing on a topic with a time constraint, about an idea you've had no prior preparation for, is intimidating!