Yes it refers to how 2 people relate to each other romantically. If two people have chemistry it means they are attracted to each on a intellectual/ personal level more so than physically. Used correctly you need to drop the "a" from the sentence so "We have A chemistry" would become "We have chemistry"