Just found this,
Furthermore, Brewing Techniques (Jan/Feb '95) had an article on a
parallel brew experiment using an aluminum brewpot and a stainless.
Laboratory analysis showed that there was no significant difference in
trace aluminum levels between batches. They also pointed out that most
of the Al you digest is from your food and water. And for that matter,
many medical people consider copper a bigger health risk.
As for off flavors, IF this happens (hearsay IMO), it is probably the
result of the brewer scrubbing the oxidation layer of the pot during
cleaning. Don't scrub, use a soft cloth or sponge and non-abrasive
cleaner. This is one of the reasons Al is not used much commercially,
its not caustic cleaner friendly.