'I caught them in an appropriate way' describes 'caught'. You caught them and that was inappropriate. Maybe you can say, "I caught them in an inappropriate act' or 'I caught them acting inappropriately' or 'I caught them doing something inappropriate'.

They are very similar.