Yes, you can say 'We can manage in English'. The 'defend' sentence doesn't really work unless someone is 'attacking' you in English!
Perhaps the phrase you are looking for is:
'We can get by in English'.
This means that we can speak enough English to make ourselves understood and to use the language at a basic, functional level.