When groundwater percolates through limestone and other sedimentary rocks, some carbonates like calcium, gypsum and magnesium mix with the water, creating hard water. It’s similar to having a little dust in the air during an HVAC system installation — small amounts are negligible and not dangerous.