Aero-tactile integration in Mandarin (2019)

View/ Open
Type of Content
Conference Contributions - PublishedPublisher
Australian Speech Science and Technology Association Inc.ISBN
978-0-646-80069-1Collections
Editors
Abstract
Previous research has shown that audio-aligned air puffs applied to the skin can enhance the perception of speech audio [12]. In this study, we applied dynamically varying air flow during two-way forced-choice identification of Mandarin words, comparing them to results of a study on English which showed perceptual enhancement for both stops and fricatives [6]. Two differences emerged: Psychometric testing identified the 80% accuracy signal-to-noise ratio for Mandarin words to be at - 1.1 dB SNR, compared to -9.0 for English nonsense syllables. In addition, in Mandarin, aero-tactile stimuli only enhanced classification of voiceless stops, whereas it enhanced classification of voiceless stops and fricatives in English. These differences may partially result from the interaction of high conditional acoustic entropy in Mandarin compared to English [24] and air flow – that is, the Mandarin syllables had to be played with more preserved acoustic information, weakening the potential effect of air flow.
Citation
Derrick D, Heyne M, O'Beirne G, Hay J (2019). Aero-tactile integration in Mandarin. Melbourne, Australia: International Congress of Phonetic Sciences. 05/08/2019-09/08/2019. Proceedings of the 19th International Congress of Phonetic Sciences, Melbourne, Australia 2019.This citation is automatically generated and may be unreliable. Use as a guide only.
Keywords
Speech Perception; Speech Acoustics; Laboratory Phonology; Multimodal PhoneticsANZSRC Fields of Research
47 - Language, communication and culture::4704 - LinguisticsRelated items
Showing items related by title, author, creator and subject.
-
Aero-tactile integration in fricatives: Converting audio to air flow information for speech perception enhancement
Derrick, Donald; O'Beirne, Greg A.; De Rybel T; Hay J (ISCA, 2014)We follow up on research demonstrating that aero-tactile information can enhance or interfere with accurate auditory perception among uninformed and untrained perceivers [1, 2, 3]. We computationally extract aperiodic ... -
Aero-tactile integration during speech perception: Effect of response and stimulus characteristics on syllable identification
Derrick, Donald; Madappallimattam J; Theys C (Acoustical Society of America (ASA), 2019)Integration of auditory and aero-tactile information during speech perception has been documented during two-way closed-choice syllable classification tasks [Gick and Derrick (2009). Nature 462, 502–504], but not during ... -
Listen with your skin: Aerotak speech perception enhancement system
Derrick, Donald; De Rybel T; O'Beirne, Greg A.; Hay J (ISCA, 2014)Here we introduce Aerotak: A system for audio analysis and perception enhancement that allows speech perceivers to listen with their skin. The current system extracts unvoiced portions of an audio signal representative of ...