Ejection of pulsars and binaries to the outskirts of globular clusters