Do diffusers affect the polarization of light?

Actually, opal and ground glass diffusers are excellent depolarizers. Light that is linearly or circularly polarized will become randomly polarized when scattered after passing through a diffuser. Please note that the same is not true for holographic diffusers. Holographic diffusers are made of a birefringent material and will act as a retarder in polarized light.