There is a difference. "I am cross with you", means I am angry with you, but not very angry and I will still speak to you. "I am not on speaking terms with you", means I am very angry with you and I will not speak to you.