Spectral dependence of CMB polarization and parity