Replacing or installing new home siding is a big investment ... For mildew or moss, which can accumulate on the exterior surfaces of damp brick, you’ll want to try a diluted bleach solution ...