Nonspecular x-ray scattering in a multilayer-coated imaging system