Lots of ways that are too much to cover here - coffeechemistry.com is a great resource if you really want to get super geeky about the chemistry of water and coffee.
Basically, though, the minerals in water act as a solvent that help extract the soluble materials from the coffee as the water passes through the grounds. If those solvents are missing, less coffee goodness gets extracted from the beans.