Aero-tactile integration in Mandarin (2019)
Previous research has shown that audio-aligned air puffs applied to the skin can enhance the perception of speech audio . In this study, we applied dynamically varying air flow during two-way forced-choice identification of Mandarin words, comparing them to results of a study on English which showed perceptual enhancement for both stops and fricatives . Two differences emerged: Psychometric testing identified the 80% accuracy signal-to-noise ratio for Mandarin words to be at - 1.1 dB SNR, compared to -9.0 for English nonsense syllables. In addition, in Mandarin, aero-tactile stimuli only enhanced classification of voiceless stops, whereas it enhanced classification of voiceless stops and fricatives in English. These differences may partially result from the interaction of high conditional acoustic entropy in Mandarin compared to English  and air flow – that is, the Mandarin syllables had to be played with more preserved acoustic information, weakening the potential effect of air flow.
CitationDerrick D, Heyne M, O'Beirne G, Hay J (2019). Aero-tactile integration in Mandarin. Melbourne, Australia: International Congress of Phonetic Sciences. 05/08/2019-09/08/2019. Proceedings of the 19th International Congress of Phonetic Sciences, Melbourne, Australia 2019.
This citation is automatically generated and may be unreliable. Use as a guide only.
KeywordsSpeech Perception; Speech Acoustics; Laboratory Phonology; Multimodal Phonetics
ANZSRC Fields of Research47 - Language, communication and culture::4704 - Linguistics
Showing items related by title, author, creator and subject.
Aero-tactile integration in fricatives: Converting audio to air flow information for speech perception enhancement Derrick, Donald; O'Beirne, Greg A.; De Rybel T; Hay J (ISCA, 2014)We follow up on research demonstrating that aero-tactile information can enhance or interfere with accurate auditory perception among uninformed and untrained perceivers [1, 2, 3]. We computationally extract aperiodic ...
Aero-tactile integration during speech perception: Effect of response and stimulus characteristics on syllable identification Derrick, Donald; Madappallimattam J; Theys C (Acoustical Society of America (ASA), 2019)Integration of auditory and aero-tactile information during speech perception has been documented during two-way closed-choice syllable classification tasks [Gick and Derrick (2009). Nature 462, 502–504], but not during ...
Derrick, Donald; De Rybel T; O'Beirne, Greg A.; Hay J (ISCA, 2014)Here we introduce Aerotak: A system for audio analysis and perception enhancement that allows speech perceivers to listen with their skin. The current system extracts unvoiced portions of an audio signal representative of ...