Listen with your skin: Aerotak speech perception enhancement system (2014)
Type of ContentConference Contributions - Published
Here we introduce Aerotak: A system for audio analysis and perception enhancement that allows speech perceivers to listen with their skin. The current system extracts unvoiced portions of an audio signal representative of turbulent air-flow in speech. It stores the audio signal in the left channel of a stereo audio output, and the air flow signal is stored in the right channel. The stored audio is used to drive a conversion unit that splits the left audio channel into a headphone out (to both ears) and right channel air pump drive signal to a piezoelectric pump that is mounted to the headphones. We have shown, using two-way forced-choice experiments, that the system enhances perception of voiceless stops and voiceless fricatives in noise such that 1 out of every 4 such words that would otherwise be missed will be heard correctly. We are currently conducting experiments on word identification while listening to a short-story, and are completing a stand-alone version of the Aerotak that works with real-time audio and from an embedded system. The short-story research and real-time system will be complete for InterSpeech 2014.
CitationDerrick D, De Rybel T, O'Beirne GA, Hay J (2014). Listen with your skin: Aerotak speech perception enhancement system. Singapore: 15th Annual Conference of the International Speech Communication Association (InterSpeech 2014). 14/09/2014-18/09/2014. Proceedings. 1484-1485.
This citation is automatically generated and may be unreliable. Use as a guide only.
Keywordsspeech perception; aero-tactile integration; embodiment theory; audio perception enhancement
ANZSRC Fields of Research47 - Language, communication and culture::4704 - Linguistics::470410 - Phonetics and speech science
Showing items related by title, author, creator and subject.
Aero-tactile integration in fricatives: Converting audio to air flow information for speech perception enhancement Derrick, Donald; O'Beirne, Greg A.; De Rybel T; Hay J (ISCA, 2014)We follow up on research demonstrating that aero-tactile information can enhance or interfere with accurate auditory perception among uninformed and untrained perceivers [1, 2, 3]. We computationally extract aperiodic ...
Aero-tactile integration during speech perception: Effect of response and stimulus characteristics on syllable identification Derrick, Donald; Madappallimattam J; Theys C (Acoustical Society of America (ASA), 2019)Integration of auditory and aero-tactile information during speech perception has been documented during two-way closed-choice syllable classification tasks [Gick and Derrick (2009). Nature 462, 502–504], but not during ...
Aero-tactile integration in Mandarin Derrick, Donald; Heyne M; O'Beirne, Greg A.; Hay J (Australian Speech Science and Technology Association Inc., 2019)Previous research has shown that audio-aligned air puffs applied to the skin can enhance the perception of speech audio . In this study, we applied dynamically varying air flow during two-way forced-choice ...