The individual atoms of a material have a net magnetic dipole moment in paramagnetic and ferromagnetic materials whereas net magnetic dipole moment is zero in diamagnetic materials.

Since, according to question, permanent magnetic moment of the material is zero, it must be a diamagnetic material.

Therefore, if permanent magnetic moment of the atoms of a material is zero, then the material must be diamagnetic.