Temporal constraints on the McGurk effect
- 1 January 1996
- journal article
- Published by Springer Nature in Perception & Psychophysics
- Vol. 58 (3) , 351-362
- https://doi.org/10.3758/bf03206811
Abstract
Three experiments are reported on the influence of different timing relations on the McGurk effect. In the first experiment, it is shown that strict temporal synchrony between auditory and visual speech stimuli is not required for the McGurk effect. Subjects were strongly influenced by the visual stimuli when the auditory stimuli lagged the visual stimuli by as much as 180 msec. In addition, a stronger McGurk effect was found when the visual and auditory vowels matched. In the second experiment, we paired auditory and visual speech stimuli produced under different speaking conditions (fast, normal, clear). The results showed that the manipulations in both the visual and auditory speaking conditions independently influenced perception. In addition, there was a small but reliable tendency for the better matched stimuli to elicit more McGurk responses than unmatched conditions. In the third experiment, we combined auditory and visual stimuli produced under different speaking conditions (fast, clear) and delayed the acoustics with respect to the visual stimuli. The subjects showed the same pattern of results as in the second experiment. Finally, the delay did not cause different patterns of results for the different audiovisual speaking style combinations. The results suggest that perceivers may be sensitive to the concordance of the time-varying aspects of speech but they do not require temporal coincidence of that information.Keywords
This publication has 45 references indexed in Scilit:
- Cross-modal discrepancies in coarticulation and the integration of speech information: The McGurk effect with mismatched vowels.Journal of Experimental Psychology: Human Perception and Performance, 1995
- On the perceptual organization of speech.Psychological Review, 1994
- Integral processing of visual place and auditory voicing information during phonetic perception.Journal of Experimental Psychology: Human Perception and Performance, 1991
- Listening with eye and hand: Cross-modal contributions to speech perception.Journal of Experimental Psychology: Human Perception and Performance, 1991
- Mechanisms in the Control of Speech RatePhonetica, 1981
- The Detection of Auditory Visual DesynchronyPerception, 1980
- Visual influences on speech perception processesPerception & Psychophysics, 1978
- Hearing lips and seeing voicesNature, 1976
- Numerical Model of CoarticulationThe Journal of the Acoustical Society of America, 1967
- Perceived order in different sense modalities.Journal of Experimental Psychology, 1961