Look me in the eye is more commonly used

Both of them make sense but the first one is uncanny used so much and sounds much better and poetic in a sense.

'Look me in the eye' is the expression you would use.

Both wrong look at me by the eye