Yes, you can.
If you say 'I've got a frozen chicken' it means that you have one whole bird - hence the singular/countable noun.
If you say 'I've got frozen chicken', this simply means that you have some of this type of meat in your freezer which is frozen. It could be several birds, or various different chicken pieces, or slices of chicken - we don't know.