If there is a strong light source (such as the sun

or those bright lights for evening outdoor games, such as foot ball) that will reach your lens, you should put it. But in a swimming pool, the light is way up in the ceiling (at least in the pool that I take pictures), there is little chance for unwanted light getting into the lens.