Unlike the English [f] where you touch your top teeth with your bottom lip, the consonant sound in ふ is bilabial - meaning both of your lips are involved, and no teeth. Simply bring your lips close together, as if you were about to whistle, and blow the air through the tight space.
This is also different from an [h] sound, because to pronounce [h] you constrict the passage of air at the back of your mouth, practically in your throat. For this Japanese sound, the constriction is in the lip area.