Investigation of gradual damage after fast neutron irradiation of silicon single crystals