Tri-modal Speech: Audio-visual-tactile Integration in Speech Perception

Simple item page
dc.contributor.authorDerrick, Donald
dc.contributor.authorHansmann D
dc.contributor.authorTheys C
dc.date.accessioned2019-11-28T22:19:55Z
dc.date.available2019-11-28T22:19:55Z
dc.date.issued2019en
dc.date.updated2019-11-21T09:21:27Z
dc.description.abstractSpeech perception is a multi-sensory experience. Visual information enhances [Sumby and Pollack (1954). J. Acoust. Soc. Am. 25, 212–215] and interferes [McGurk and MacDonald (1976). Nature 264, 746–748] with speech perception. Similarly, tactile information, transmitted by puffs of air arriving at the skin and aligned with speech audio, alters [Gick and Derrick (2009). Nature 462, 502–504] auditory speech perception in noise. It has also been shown that aero-tactile information influences visual speech perception when an auditory signal is absent [Derrick, Bicevskis, and Gick (2019a). Front. Commun. Lang. Sci. 3(61), 1–11]. However, researchers have not yet identified the combined influence of aero-tactile, visual, and auditory information on speech perception. The effects of matching and mismatching visual and tactile speech on two-way forced-choice auditory syllable-in-noise classification tasks were tested. The results showed that both visual and tactile information altered the signal-to-noise threshold for accurate identification of auditory signals. Similar to previous studies, the visual component has a strong influence on auditory syllable-in-noise identification, as evidenced by a 28.04dB improvement in SNR between matching and mismatching visual stimulus presentations. In comparison, the tactile component had a small influence resulting in a 1.58dB SNR match-mismatch range. The effects of both the audio and tactile information were shown to be additive.en
dc.identifier.citationDonald Derrick, Doreen Hansmann, Catherine Theys. (2019) Tri-modal speech: Audio-visual-tactile integration in speech perception. The Journal of the Acoustical Society of America 146:5, 3495-3504.en
dc.identifier.doihttps://doi.org/10.1121/1.5134064
dc.identifier.issn0001-4966
dc.identifier.urihttp://hdl.handle.net/10092/17714
dc.language.isoen
dc.subject.anzsrcField of Research::17 - Psychology and Cognitive Sciences::1702 - Cognitive Science::170204 - Linguistic Processes (incl. Speech Production and Comprehension)en
dc.titleTri-modal Speech: Audio-visual-tactile Integration in Speech Perceptionen
dc.typeJournal Articleen
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
Derrick_J. Acoust. Soc. Am_2019_146_Tri-modal.pdf
Size:
1.71 MB
Format:
Adobe Portable Document Format
Download
Collections
NZILBB: Journal Articles