Permanent hardness in water is caused due to the presence of soluble salts of magnesium and calcium in the form of chlorides or sulphates in water.

So the chlorides as well as sulphates are responsible for causing permanent hardness in water.