"Hotel X is not my scene" means "I don't like the ambiance/environment at hotel X." Generally, the expression is only used to describe a physical place, a situation, a scenario, or some kind of environment. You wouldn't say "peanut butter and jam sandwiches are not my scene." But you can definitely say "crowded and smokey bars are not my scene."