There is no difference between the two. They are synonym but "parfois" is more common (I think). Personally, I use more "parfois" than "quelquefois" when I talk with friends. Actually I never thought about it... It's so natural for me ^^'
Ca me dérange pas means it doesn't bother me.