Either is OK. They have a slightly different meaning. 'with' implies a discussion, so is more friendly. 'to' can also be a discussion, but can also be something more one-sided, such as a 'telling-off'. It would be better to say 'Which of them is correct?'