According to Osho, your fear of women isn't personal—it's the universal fear of love. We fear love because it is a 'small death': it asks surrender, vulnerability, and loss of control, while the ego wants the other to surrender instead. Since woman is the beloved, man fears her as the doorway to this surrender, just as women fear men for the same reason.
You’re scared of women because getting close means letting go of control, and your ego resists that.