A top is something someone (usually a girl) wears on the top half of their body. It could be a shirt, a blouse or whatever. Girls clothes are sometimes difficult to describe, so they are often called tops.
He's saying he didn't recognise the girl because he usually met her when she wasn't wearing a top!