The low-temperature phase of discontinuous mean-field spin glasses is generally described by a one-step replica symmetry breaking (1RSB) Ansatz. The Gardner transition, i.e. a very-low-temperature phase transition to a full replica symmetry breaking (FRSB) phase, is often regarded as an inessential, and somehow exotic phenomenon. In this paper we show that the metastable states which are relevant for the out-of-equilibrium dynamics of such systems are always in a FRSB phase. The only exceptions are (to the best of our knowledge) the p-spin spherical model and the random energy model (REM). We also discuss the consequences of our results for aging dynamics and for local search algorithms in hard combinatorial problems.