Auditory speech processing is affected by visual speech in the periphery

Jeesun Kim, Chris Wayne Davis

Research output: Contribution to conferencePaper

1 Citation (Scopus)

Abstract

Two experiments were conducted to determine whether visual speech presented in the visual periphery affects the perceived identity of speech sounds. Auditory speech targets (vCv syllables) were presented in noise (-8 dB) with congruent or incongruent visual speech presented in full-face or upper-half face conditions. Participants' eye-movements were monitored to assure that visual speech input occurred only from the periphery. In Experiment 1 participants had only to identify what they heard. The results showed that peripherally presented visual speech (full-face) facilitated identification of AV congruent stimuli compared to the upper-face control. Likewise, visual speech reduced correct identification for the incongruent stimuli. Experiment 2 was the same as the first except that in addition participants performed a central visual task. Once again significant effects of visual speech were found. These results show that peripheral visual speech affects speech recognition.

Original languageEnglish
Pages2465-2468
Number of pages4
Publication statusPublished - 1 Dec 2011
Event12th Annual Conference of the International Speech Communication Association, INTERSPEECH 2011 -
Duration: 27 Aug 2011 → …

Conference

Conference12th Annual Conference of the International Speech Communication Association, INTERSPEECH 2011
Period27/08/11 → …

Keywords

  • Attention
  • Auditory-visual congruency
  • Auditory-visual speech
  • Visual periphery
  • Visual speech

Fingerprint Dive into the research topics of 'Auditory speech processing is affected by visual speech in the periphery'. Together they form a unique fingerprint.

  • Cite this

    Kim, J., & Davis, C. W. (2011). Auditory speech processing is affected by visual speech in the periphery. 2465-2468. Paper presented at 12th Annual Conference of the International Speech Communication Association, INTERSPEECH 2011, .