Brick and the mortar are porous so the mildew/algae isn't just on the surface. The pressure washer can only get to the surface though. You're going to need some bleach or other chemical to mill mildew/algae. A scrub brush will help, but might take several soaking applications.