Off-Ecliptic Control of Cosmic Ray Modulation