Arabic language is different than most latin based languages. At first, its character set is totally alien to you. Secondly, you will encounter the grammar problem. Thirdly, you will face a pronunciation problem. But you can hurdle all of these if you are really determined to learn Arabic. Just take it easy. Learn step-by-step. One at a time. Soon you will develop a certain level of comfort in sppken Arabic.
But to start, you have to find some site with Arabic to English translation and transliteration or romanized spelling of arabic words, phrases and sentence so you can immediately practice speaking. There are many sites where you can get text, audio, and video lessons like youtube, take time to search these materials. Find a native speaker to help you. Get an account with SKYPE and listen to LIVE conversation by arabic speaking people. Remember, Arabic language in different places also has some differences. So, a Saudi may find some difficulty in listening to a Syrian Arabic speakers. Your native partner can rate your progress and proficiency level in spoken Arabic. Then try learning the written Arabic. It is here where you can probably find the difficulty you have in mind. Good Luck!