Remember that characters in movies don't always speak in a correct, grammatical way...! ;-)
I assume here they just omitted the verb 'are' from the start of the question, so in full it would be "Are you refusing to serve the court?" - this kind of omission occurs sometimes in informal speech, or sometimes the 'are' is just barely pronounced.
Hope that helps!