It depends exactly what kind of container it is, but most likely you mean to say "a plastic cup." By the way, you are correct to imagine that if you say a "plastic glass" people may think you're weird…. Btw, have you heard English speakers use the term "boiled ice?"