Hi Min,
In your first sentence, omitting "when/"that" sounds fine. However, we don't say "goes nervous", but rather, "gets nervous." Therefore, the sentence should be "Every time the phone rings, he gets nervous."
As for your second sentence, omitting "when" sounds unnatural. As for replacing it with "that", that also sounds unnatural.