You can say either. "Warm" means "a little hot." "Warm up" suggests that you are heating it a little, "heat up" suggests that you are heating it a lot.
Also, to "warm up" is to prepare for a strenuous athletic effort by doing easy exercises first. Also, before a show, someone may "warm up" an audience by telling them jokes to get them to a relaxed mood.