How and What to Sample in the Analytical Gap