The smooth pursuit system is traditionally employed using a single small target moving on a homogeneous background. It still is not fully understood, however, how accurate tracking is sustained in the presence of a structured background, which will activate global motion processing in the opposite direction as a consequence of the ongoing eye movement. To further study this interaction, we used brief shifts of a textured background injected at various times during the initiation of smooth pursuit. While shifts opposite to the target direction did not alter smooth pursuit performance, those in the same direction resulted in a marked transient perturbation of the pursuit. These results suggest a simple yet limited mechanism that adjusts the sensitivity of global motion processing.