I don't take mine out in adverse weather often but when I do I keep them covered. I don't use sprays and I don't use baby powder. If you use some common sense ( sandwich bags, saran wrap, free plastic grocery bags? ), the effects of weather will be minimal.
It sounds as though the weather you are hunting in is much worse than what I'm accustomed to.