First, it is "Which is correct?" Second, both are correct. You are usually responsible for doing certain tasks or duties. This can include anything from washing windows to making sure the international space station is working correctly. You can also be responsible for the upbringing and training of children. When you are responsible to someone, that means that they are someone you report to and they hold you accountable for certain tasks.