If you fling something to the wind, figuratively you let it go, give it up or abandon it. In this case, what he is letting go is discretion, caution. He is acting with no thought of what could happen and what people or the woman might think. If he was doing this with discretion, judgement or caution, he would wait until he was completely sure of her reaction before kissing and embracing her.