You do not need 'at' because you are not being specific. If you were to nominate a time or place you would use 'at'

Thanks

As Michelle suggests I want to have a cup of tea somewhere with a nice view. I want to have a cup of tea at the teahouse.