There's not a satisfying explanation, I'm afraid. It is a frequently used and common phrase and therefore conventionalised. German simply realises this question differently.
You're of course right that, in general, 'what' means 'was'. You can regard the above question as an exception.