You've got the wrong idea here. pH of tap water will be controlled by your water authority to be about pH 7-9 and has little to do with "hardness". My water can be over pH8, but at less than 100ppm dissolved solids is very "soft".
As
@foxy was saying, pH5.5 is about the sweet spot for sparge water because the water then contains very little "alkalinity". Make it to a point just below 5.0 and it'll contain no "alkalinity", but there is nothing to gain by going past 5.5. It is undesirable to allow the mash to rise above ph5.8 when sparging, as "alkalinity" is a measure of how resistant water is to having pH lowered, reducing "alkalinity" to near nowt means there isn't much (any) chance of your mash rising above pH5.8.
"Alkalinity" and "temporary hardness" (carbonate hardness) is connected, "alkalinity" and "permanent hardness" (mainly calcium and magnesium ions) has little (that's not saying "nothing"!) to do with each other.