The horns here are referring to bull horns. 'On the horns' means you're grapple a bull's horns. Here it's a metaphor. You're 'grappling' with a dilemma like you would a bull's horns.

it a phrase ,it should be translate together,it hesitated whether it is forward or back word