The roles of speciation and divergence time in the loss of duplicate gene expression