Aero-tactile integration in fricatives: Converting audio to air flow information for speech perception enhancement (2014)

View/ Open
Type of Content
Conference Contributions - PublishedPublisher
ISCAISSN
2308-457X1990-9772
Collections
Editors
Abstract
We follow up on research demonstrating that aero-tactile information can enhance or interfere with accurate auditory perception among uninformed and untrained perceivers [1, 2, 3]. We computationally extract aperiodic information from auditory recordings of speech, which represents turbulent air-flow produced from the lips [4, 5]. This extracted signal is used to drive a piezoelectric air-pump producing air-flow to the right temple simultaneous with presentation of auditory recordings. Using forced-choice experiments, we replicate previous results with stops, finding enhanced perception of /pa/ in /pa/ vs. /ba/ pairs, and /ta/ in /ta/ vs. /da/ pairs [1, 6, 2, 3]. We also found enhanced perception of /fa/ in /ba/ vs. /fa/ pairs, and /sha/ in /da/ vs. /sha/ pairs, demonstrating that air flow during fricative production contacting the skin can also enhance speech perception. The results show that aero-tactile information can be extracted from the audio signal and used to enhance speech perception of a large class of speech sounds found in many languages of the world.
Citation
Derrick D, O'Beirne G, De Rybel T, Hay J (2014). Aero-tactile integration in fricatives: Converting audio to air flow information for speech perception enhancement. Singapore: 15th Annual Conference of the International Speech Communication Association (InterSpeech 2014). 14/09/2014-18/09/2014. INTERSPEECH 2014. 2580-2584.This citation is automatically generated and may be unreliable. Use as a guide only.
Keywords
speech perception; aero-tactile integration; embodiment theory; audio perception enhancementANZSRC Fields of Research
47 - Language, communication and culture::4704 - LinguisticsRelated items
Showing items related by title, author, creator and subject.
-
Listen with your skin: Aerotak speech perception enhancement system
Derrick, Donald; De Rybel T; O'Beirne, Greg A.; Hay J (ISCA, 2014)Here we introduce Aerotak: A system for audio analysis and perception enhancement that allows speech perceivers to listen with their skin. The current system extracts unvoiced portions of an audio signal representative of ... -
Aero-tactile integration in Mandarin
Derrick, Donald; Heyne M; O'Beirne, Greg A.; Hay J (Australian Speech Science and Technology Association Inc., 2019)Previous research has shown that audio-aligned air puffs applied to the skin can enhance the perception of speech audio [12]. In this study, we applied dynamically varying air flow during two-way forced-choice ... -
Aero-tactile integration during speech perception: Effect of response and stimulus characteristics on syllable identification
Derrick, Donald; Madappallimattam J; Theys C (Acoustical Society of America (ASA), 2019)Integration of auditory and aero-tactile information during speech perception has been documented during two-way closed-choice syllable classification tasks [Gick and Derrick (2009). Nature 462, 502–504], but not during ...