Effect of anisotropic scattering on the upper critical field of high-field superconductors