Late evolution of very low mass X-ray binaries sustained by radiation from their primaries