The effects of irradiation on the normal metal of a composite superconductor: a comparison of copper and aluminum