CONTENTS
BEING BIOLOGICAL
SIMULACRA
SPEECH SYNTHESIS
VOCAL TRACTS
ARTICULATORS
SPEECH PRODUCTION
MCGURK
SPEECHREADING
FACIAL ANIMATION
AVATARS
BACKGROUND
DIRECTORY
BIBLIOGRAPHY

Talking Heads:
Bibliography

     Articulatory synthesis | Avatars | Facial animation | McGurk
Speech - general | Speech synthesis | Speech production | Speechreading


 
The McGurk Effect:

Baynes, K., Funnell, M. G., & Fowler, C. A. (1994). Hemispheric contributions to the integration of visual and auditory information in speech perception. Perception and Psychophysics, 55, 633-41.

Bertelson, P. & Radeau, M. (1981). Cross-modal bias and perceptual fusion with auditory-visual spatial discordance. Perception and Psychophysics, 29, 578-584.

Bertelson, P., Vroomen, J., Wiegeraad, G., & deGelder, B. (1994). Exploring the relation between McGurk interference and ventriloquism. In Proceedings of the 1994 International Conference on Spoken Language Processing, Sep. 18-22, Yokohama, Japan, Vol. II, 559-562.

Burnham, D. (1992). Processing auditory-visual speech in infancy and across phonologies. International Journal of Psychology, 27, 59.

Burnham, D. (1998). Language specificity in the development of auditory-visual speech perception. In R. Campbell, B. Dodd, & D. Burnham (Eds.) (1998). Hearing by Eye II: Advances in the Psychology of Speechreading and Auditory-visual Speech. Psychology Press Ltd., East Sussex, UK, 27-60.

Burnham, D. & Dodd, B. (1996). Auditory-visual speech perception as an direct process: the McGurk effect in human infants and across language. In D. G. Stork & M. E. Hennecke (Eds.), Speechreading by Humans and Machines. Berlin: Springer-Verlag, 103-114.

Campbell, R., Dodd, B., & Burnham, D. (Eds.) (1998). Hearing by Eye II: Advances in the Psychology of Speechreading and Auditory-visual Speech. Psychology Press Ltd., East Sussex, UK.

Campbell, R., Garwood, J., Frankslin, S., Howard, D., Landis, T., & Regard, M. (1990). Neuropsychological studies of auditory-visual fusion illusions: Four case studies and their implications. Neuropsychologia, 28, 787-802.

de Gelder, B., Bertelson, P., & Vroomen, J. (1996). Aspects of modality in audio-visual processes. In D. G. Stork & M. E. Hennecke (Eds.), Speechreading by Humans and Machines: Models, Systems, and Applications, Springer-Verlag, New York, 179-191.

Grassegger, H. (1995). McGurk effect in German and Hungarian listeners. International Congress of Phonetics Sciences, Stockholm, 4, 210-213.

Green, K. P. (1996). The use of auditory and visual information in phonetic perception. In D. G. Stork & M. E. Hennecke (Eds.), Speechreading by Humans and Machines. Berlin: Springer-Verlag, 55-77.

Green, K. P. (1998). The use of auditory and visual information during phonetic processing: implications for theories of speech perception. In R. Campbell, B. Dodd, & D. Burnham (Eds.) (1998). Hearing by Eye II: Advances in the Psychology of Speechreading and Auditory-visual Speech. Psychology Press Ltd., East Sussex, UK, 3-25.

Green, K. P. & Gerdeman, A. (1995). Cross-modeal discrepancies in coarticulation and the integration of speech information: The McGurk effect with mismatched vowels. Journal of Experimental Psychology: Human Perception and Performance, 25, 1409-1426.

Green, K. P. & Kuhl, P. K. (1989). The role of visual information in the processing of place and manner features in speech perception. Perception and Psychophysics, 45, 34-42.

Green, K. P. & Kuhl, P. K. (1991). Integral processing of visual place and auditory voicing information during phonetic perception. Journal of Experimental Psychology: Human Perception and Performance, 17, 278-288.

Green, K. P., Kuhl, P. K., Meltzoff, A. N., & Stevens, E. B. (1991). Integrating speech informatin across talkers, gender, and sensory modality: Female faces and male voices in the McGurk effect. Perception and Psychophysics, 50, 524-536.

Green, K. P. & Norrix, L. W. (1997). Acoustic cues to place of articulation and the McGurk effect: The role of release burts, aspiration, and formant transitions. Journal of Speech, Language and Hearing Research, 40, 646-665.

Hockley, S. N. & Polka, L. (1994). A developmental study of audio-visual speech perception using the McGurk paradigm. Journal of the Acoustical Society of America, 96, 3309.

Kuhl, P. K. & Meltzoff, A. (1982). The bimodal perception of speech in infancy. Science, 218, 1138-1141.

Kuhl, P. K., Tsuzaki, M., Tohkura, Y., & Meltzoff, A. (1994). Human processing of auditory-visual information in speech perception: potential for multimodal human-machine interfaces. In Proceedings of the International Conference on Spoken Language Processing, Kyoto, 539-542.

MacDonald, J. & McGurk, H. (1978). Visual influences on speech perception process. Perception and Psychophysics, 24, 253-257.

Massaro, D. W. (1984). Children's perception of visual and auditory speech. Child Development, 55, 1777-1788.

Massaro, D. W. (1987). Speech perception by ear and eye: A paradigm for psychological inquiry. Lawrence Erlbaum Associates, Hillsdale, NJ.

Massaro, D. W. (1998). Perceiving talking faces: from speech perception to a behavioral principle. MIT Press, Cambridge, MA.

Massaro, D. W., Cohen, M. M., & Smeele, P. M. T. (1996). Perception of asynchronous and conflicting visual and auditory speech. Journal of the Acoustical Society of America, 100, 1777-1786.

McGurk, H. (1981). Listening with eye and ear (paper discussion). In T. Myers, J. Laver, & J. Anderson (Eds.) The Cognitive Representation of Speech. Amsterdam: North-Holland.

Massaro, D. W., Tsuzaki, M., Cohen, M., Gesi, A., & Heridia, R. (1993). Bimodal speech perception: An examination across languages. Journal of Phonetics, 21, 445-478.

McGurk, H. & Lewis, M. (1974). Space perception in early infancy: perception within a common auditory-visual space. Science, 186, 649-650.

McGurk, H. & MacDonald, J. W. (1976). Hearing lips and seeing voices. Nature, 264, 746-748.

Munhall, K.G., Gribble, P.L., Sacco, L., & Ward, M. (1996). Temporal constraints on the perception of the McGurk effect. Perception and Psychophysics, 58(3):351-362.

Robert-Ribes, J., Schwartz, J.-L., & Escudier, P. (1995). A comparison of models for fusion of the auditory and visual sensors in speech perception. Artificial Intelligence Review, 9, 323-346.

Rosenblum, L.D. & Saldaña, H.M. (1992). Discrimination tests of visually-influenced syllables. Perception and Psychophysics. 52 (4), 461-473.

Rosenblum, L.D., Schmuckler, M.A., & Johnson, J.A. (1997). The McGurk effect in infants. Perception & Psychophysics, 59 (3), 347-357.

Saldaña, H.M. & Rosenblum, L.D. (1993). Visual influences on auditory pluck and bow judgments. Perception and Psychophysics, 54 (3), 406-416.

Sekiyama, K. (1994). Differences in auditory-visual speech perception between Japanese and America: McGurk effect as a function of incompatibility. Journal of the Acoustical Society of Japan, 15, 143-158.

Sekiyama, K. (1996). Cultural and linguistic factors in audiovisual speech processing: The McGurk effect in Chinese subjects. Perception and Psychophysics, 59, 73.

Sekiyama, K. & Tohkura, Y. (1991). McGurk effect in non-English listeners: Few visual effects for Japanese subjects hearing Japanese syllables of high auditory intelligibility. Journal of the Acoustical Society of America, 90, 1797-1805.

Sekiyama, K. & Tohkura, Y. (1993). Inter-language differences in the influence of visual cues in speech perception. Journal of Phonetics, 21, 427-444.

Stork D. G. & Hennecke, M. E. (Eds.) (1996). Speechreading by Humans and Machines. Springer-Verlag, Berlin.

Sumby, W. H. & Pollack, I. (1954). Visual contributions to speech intelligibility in noise. Journal of the Acoustical Society of America, 26, 212-215.

Vroomen, J. M. H. (1992). Hearing Voices and Seeing Lips. Ph.D. Dissertation, Katholieke Universiteit Brabant.

Werker, J. F., Frost, P., & McGurk, H. (1992). Cross-language influences on bimodal speech perception. Canadian Journal of Psychology, 46, 551-568.

Yakel, D.A., Rosenblum, L.D., Green, K.P., Bosley, C.L., & Vasquez, R.A. (1995). The effect of face and lip inversion on audiovi˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙ournal of the Acoustical Society of America, 26, 212-215.

Vroomen, J. M. H. (1992). Hearing Voices and Seeing Lips. Ph.D. Dissertation, Katholieke Universiteit Brabant.

Werker, J. F., Frost, P., & McGurk, H. (1992). Cross-language influences on bimodal speech perception. Canadian Journal of Psychology, 46, 551-568.

Yakel, D.A., Rosenblum, L.D., Green, K.P., Bosley, C.L., & V˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙ournal of the Acoustical Society of America, 26, 212-215.

Vroomen, J. M. H. (1992). Hearing Voices and Seeing Lips. Ph.D. Dissertation, Katholieke Universiteit Brabant.

Werker, J. F., Frost, P., & McGurk, H. (1992). Cross-language influences on bimodal speech perception. Canadian Journal of Psychology, 46, 551-568.

Yakel, D.A., Rosenblum, L.D., Green, K.P., Bosley, C.L., & V˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙˙ournal of the Acoustical Society of America, 26, 212-215.

Vroomen, J. M. H. (1992). Hearing Voices and Seeing Lips. Ph.D. Dissertation, Katholieke Universiteit Brabant.

Werker, J