Yes, you can use "on the other hand" by itself (I'm pretty sure anyway). I would say: "Men tend to like outdoor sports. On the other hand, women prefer to stay at home." You have to either separate that into 2 sentences, or put a semi-colon (;) in between the 2 parts.

Be careful not to leave out the "the" in "on THE one hand".