1 is more correct, but needs punctuation. Every time, I ask him by email, but he never replies. This implies that when A (something) happens, you ask him by email, but he never replies. If you are saying that he never replies to a single email, it might be stated better as: Every time I ask him by email, he never replies.