Perceiving foreign-accented auditory-visual speech in noise: The influence of visual form and timing information

Saya Kawase, Jeesun Kim, Vincent Aubanel, Chris Wayne Davis

Research output: Contribution to conferencePaper

Abstract

The present study examined the extent to which visual form and timing information assisted in the perception of native English and Japanese-accented English speech in noise. We also examined whether the degree of visual facilitation would be mediated by the talkers’ English experience. Thirty native Australian English listeners performed a speech perception in noise task with English sentences produced by inexperienced and experienced Japanese talkers as well as a native English talker. The Japanese speakers were selected from a previous study where acoustic analyses showed that the speech rhythm of the inexperienced talker was more influenced by their native language than to the experienced one. The stimulus sentences were presented under the three conditions: Audioonly, Audio-visual (visual form and timing) and Audio-visual with mouth covered (visual timing only). The results showed a visual timing facilitation effect for the stimuli produced by the experienced but not in the inexperienced Japanese talker. A facilitative form effect was found for all the talker groups but the size of this effect decreased as the degree of the non-native experience decreased. Our findings illustrate the influence of L2 talker’s experience on the effectiveness of their visual form and timing cues.

Original languageEnglish
Pages487-488
Number of pages2
DOIs
Publication statusPublished - 1 Jan 2016
Event8th Speech Prosody 2016 -
Duration: 31 May 2016 → …

Conference

Conference8th Speech Prosody 2016
Period31/05/16 → …

Keywords

  • Auditory and visual speech processing
  • Foreign-accented speech perception
  • Form and timing
  • Visual speech

Fingerprint Dive into the research topics of 'Perceiving foreign-accented auditory-visual speech in noise: The influence of visual form and timing information'. Together they form a unique fingerprint.

  • Cite this

    Kawase, S., Kim, J., Aubanel, V., & Davis, C. W. (2016). Perceiving foreign-accented auditory-visual speech in noise: The influence of visual form and timing information. 487-488. Paper presented at 8th Speech Prosody 2016, . https://doi.org/10.21437/speechprosody.2016-99