You would only really use that phrase if you were romantically interested in someone. You wouldn't use it in the context of friendship or just to express that you find someone interesting.

Both.