Listening With Eye and Hand: Cross-Modal Contributions to Speech Perception.

Number 764
Year 1991
Drawer 14
Entry Date 11/08/1999
Authors Fowler, C. A., & Dekle, D. J.
Contact
Publication Journal of Experimental Psychology: Human Perception and Performance, 17(3), 816-828.
url http://www.haskins.yale.edu/Reprints/HL0764.pdf
Abstract Three experiments investigated the "McGurk effect" whereby optically specified syllables experienced synchronously with acoustically specified syllables integrate in perception to determine a listener's auditory perceptual experience. Experiments contrasted the cross-modal effect of orthographic on acoustic syllables presumed to be associated in experience and memory with that of haptically experienced and acoustic syllables presumed not to be associated. The latter pairing gave rise to cross-modal influences when Ss were informed that cross-modal syllables were paired independently. Mouthed syllables affected reports of simultaneously heard syllables (and vice versa). These effects were absent when syllables were simultaneously seen (spelled) and heard. The McGurk effect does not arise from association in memory but from conjoint near specification of the same casual source in the environment--in speech, the moving vocal tract producing phonetic gestures.
Notes

Search Publications