Hearing speech in noise: Seeing a loud talker is better

Jeesun Kim, Amanda Sonic, Chris Wayne Davis

Research output: Contribution to journalArticlepeer-review

21 Citations (Scopus)

Abstract

Seeing the talker improves the intelligibility of speech degraded by noise (a visual speech benefit). Given that talkers exaggerate spoken articulation in noise, this set of two experiments examined whether the visual speech benefit was greater for speech produced in noise than in quiet. We first examined the extent to which spoken articulation was exaggerated in noise by measuring the motion of face markers as four people uttered 10 sentences either in quiet or in babble-speech noise (these renditions were also filmed). The tracking results showed that articulated motion in speech produced in noise was greater than that produced in quiet and was more highly correlated with speech acoustics. Speech intelligibility was tested in a second experiment using a speech-perception-in-noise task under auditory-visual and auditory-only conditions. The results showed that the visual speech benefit was greater for speech recorded in noise than for speech recorded in quiet. Furthermore, the amount of articulatory movement was related to performance on the perception task, indicating that the enhanced gestures made when speaking in noise function to make speech more intelligible.

Original languageEnglish
Pages (from-to)853-862
Number of pages10
JournalPerception
Volume40
Issue number7
DOIs
Publication statusPublished - 2011

Fingerprint Dive into the research topics of 'Hearing speech in noise: Seeing a loud talker is better'. Together they form a unique fingerprint.

Cite this