"Whole wheat" refers to a very specific type of "brown bread." It is worth mentioning that while "white bread" is frequently used, "brown bread" is not, as it is typically referred to as "whole wheat," "whole grain," etc.

I think at one time, maybe 50ish years ago, bread in some circles of the US was "white" or 'brown", but in my experience we would use other terms now.