非 can have many different meanings in different contexts.
It means wrong in 是非(right and wrong), i'll give you some examples, 孰是孰非,是非难辨.
It can also mean to blame,比如:非难;无可厚非.
And in this sentence: 我非去不可。非 means must.
And also 非 means 不是(be not), so 并不(是) is the same thing as 并非,but 并非 sounds more formal to a native ear. For example, 这并不是/并非最明智的做法。
But 并 doesn't necessarily have to go with 非,you can see that in 非此即彼(literally 不是这个就是那个, or in english: either this or that), 非 alone means 不是
And in 非洲,南非,东非,非 means Africa :)
Hope this will help you understand the word more thoroughly.