Maybe I was just lucky, but I brewed outside for 20 years and didn't suffer any infections. Biggest challenge was maintaining mash temperature, which I did by regular stirring and checking.
Now I'm indoors I prefer it, but if I needed to I'd happily brew outside again. Better than not brewing.