Yes the refractive index changes with the color of the light because refractive index changes with the change in the wavelength and different colors have different wavelength. Due to it refractive index of violet color is highest and of red color is lowest.