Use of visual information in speech perception: Evidence for a visual rate effect both with and without a McGurk effect.

Number 1408
Year 2005
Drawer 26
Entry Date 04/08/2008
Authors Brancazio, L. & Miller, J.L.
Contact
Publication Perception & Psychophysics, V. 67:No. 5, pp. 759-769.
url http://www.haskins.yale.edu/Reprints/HL1408.pdf
Abstract The McGurk effect, where an incongruent visual syllable influences identification of an auditory syllable, does not always occur, suggesting that perceivers sometimes fail to use relevant visual phonetic information. We tested whether another visual phonetic effect, which involves the influence of visual speaking rate on perceived voicing (Green & Miller, 1985), would occur in instances when the McGurk effect does not. In Experiment 1, we established this visual rate effect using auditory and visual stimuli matching in place of articulation, finding a shift in the voicing boundary along an auditory voice-onset-time continuum with fast versus slow visual speech tokens. In Experiment 2, we used auditory and visual stimuli differing in place of articulation and found a shift in the voicing boundary due to visual rate when the McGurk effect occurred and, more critically, when it did not. The latter finding indicates that phonetically relevant visual information is used in speech perception even when the McGurk effect does not occur, suggesting that the incidence of the McGurk effect underestimates the extent of audio-visual integration.
Notes

Search Publications