Selective Attention and Multisensory Integration: Multiple Phases of Effects on the Evoked Brain Activity
Top Cited Papers
- 1 July 2005
- journal article
- research article
- Published by MIT Press in Journal of Cognitive Neuroscience
- Vol. 17 (7) , 1098-1114
- https://doi.org/10.1162/0898929054475172
Abstract
We used event-related potentials (ERPs) to evaluate the role of attention in the integration of visual and auditory features of multisensory objects. This was done by contrasting the ERPs to multisensory stimuli (AV) to the sum of the ERPs to the corresponding auditory-only (A) and visual-only (V) stimuli [i.e., AV vs. (A + V)]. V, A, and VA stimuli were presented in random order to the left and right hemispaces. Subjects attended to a designated side to detect infrequent target stimuli in either modality there. The focus of this report is on the ERPs to the standard (i.e., nontarget) stimuli. We used rapid variable stimulus onset asynchronies (350-650 msec) to mitigate anticipatory activity and included "no-stim" trials to estimate and remove ERP overlap from residual anticipatory processes and from adjacent stimuli in the sequence. Spatial attention effects on the processing of the unisensory stimuli consisted of a modulation of visual P1 and N1 components (at 90-130 msec and 160-200 msec, respectively) and of the auditory N1 and processing negativity (100-200 msec). Attended versus unattended multisensory ERPs elicited a combination of these effects. Multisensory integration effects consisted of an initial frontal positivity around 100 msec that was larger for attended stimuli. This was followed by three phases of centro-medially distributed effects of integration and/or attention beginning at around 160 msec, and peaking at 190 (scalp positivity), 250 (negativity), and 300-500 msec (positivity) after stimulus onset. These integration effects were larger in amplitude for attended than for unattended stimuli, providing neural evidence that attention can modulate multisensory-integration processes at multiple stages.Keywords
This publication has 58 references indexed in Scilit:
- PrefaceCognitive Brain Research, 2002
- Cross-Modal Interactions between Audition, Touch, and Vision in Endogenous Spatial Attention: ERP Evidence on Preparatory States and Sensory ModulationsJournal of Cognitive Neuroscience, 2002
- Spatial relevance determines facilitatory and inhibitory effects of auditory covert spatial orienting.Journal of Experimental Psychology: Human Perception and Performance, 1999
- Enhancement of selective listening by illusory mislocation of speech sounds due to lip-readingNature, 1996
- Visual influences on auditory pluck and bow judgmentsPerception & Psychophysics, 1993
- Distortion of ERP averages due to overlap from temporally adjacent ERPs: Analysis and correctionPsychophysiology, 1993
- Allocation of visual attention to spatial locations: Tradeoff functions for event-related brain potentials and detection performancePerception & Psychophysics, 1990
- The P3 complex as an index of information processing: The effects of response probabilityBiological Psychology, 1983
- Hearing lips and seeing voicesNature, 1976
- Auditory localization: The importance of eye movements and a textured visual environmentPerception & Psychophysics, 1972