You might be looking for something that's analogous to 温泉 (onsen) vs 銭湯 (sentō) in Japan.
By definition, onsen is hot spring water which (supposedly) contains minerals and other things that makes the bath more healthy and provide relaxation benefits (animated green in KonoSuba), while sentō is normal heated tap water (animated blue).
Aqua purifying the onsen water would have implied that she had taken out all the "impurities" (i.e. the beneficial minerals) in the water, and leaving it with the inferior "just hot water."
Regarding animation, it's not always consistent that onsen water is colored green.
Here's more information on sentō vs onsen.