University of Canterbury Home
    • Admin
    UC Research Repository
    UC Library
    JavaScript is disabled for your browser. Some features of this site may not work without it.
    View Item 
    1. UC Home
    2. Library
    3. UC Research Repository
    4. UC Research Centres
    5. NZ Institute of Language, Brain and Behaviour
    6. NZILBB: Conference Contributions
    7. View Item
    1. UC Home
    2.  > 
    3. Library
    4.  > 
    5. UC Research Repository
    6.  > 
    7. UC Research Centres
    8.  > 
    9. NZ Institute of Language, Brain and Behaviour
    10.  > 
    11. NZILBB: Conference Contributions
    12.  > 
    13. View Item

    Aero-tactile integration in fricatives: Converting audio to air flow information for speech perception enhancement (2014)

    Thumbnail
    View/Open
    Published version (446.9Kb)
    Type of Content
    Conference Contributions - Published
    UC Permalink
    https://hdl.handle.net/10092/18020
    
    Publisher
    ISCA
    ISSN
    2308-457X
    1990-9772
    Collections
    • NZILBB: Conference Contributions [16]
    Authors
    Derrick, Donald cc
    O'Beirne, Greg A. cc
    De Rybel T
    Hay J
    show all
    Editors
    Li H
    Meng HM
    Ma B
    Chng E
    Xie L
    Abstract

    We follow up on research demonstrating that aero-tactile information can enhance or interfere with accurate auditory perception among uninformed and untrained perceivers [1, 2, 3]. We computationally extract aperiodic information from auditory recordings of speech, which represents turbulent air-flow produced from the lips [4, 5]. This extracted signal is used to drive a piezoelectric air-pump producing air-flow to the right temple simultaneous with presentation of auditory recordings. Using forced-choice experiments, we replicate previous results with stops, finding enhanced perception of /pa/ in /pa/ vs. /ba/ pairs, and /ta/ in /ta/ vs. /da/ pairs [1, 6, 2, 3]. We also found enhanced perception of /fa/ in /ba/ vs. /fa/ pairs, and /sha/ in /da/ vs. /sha/ pairs, demonstrating that air flow during fricative production contacting the skin can also enhance speech perception. The results show that aero-tactile information can be extracted from the audio signal and used to enhance speech perception of a large class of speech sounds found in many languages of the world.

    Citation
    Derrick D, O'Beirne G, De Rybel T, Hay J (2014). Aero-tactile integration in fricatives: Converting audio to air flow information for speech perception enhancement. Singapore: 15th Annual Conference of the International Speech Communication Association (InterSpeech 2014). 14/09/2014-18/09/2014. INTERSPEECH 2014. 2580-2584.
    This citation is automatically generated and may be unreliable. Use as a guide only.
    Keywords
    speech perception; aero-tactile integration; embodiment theory; audio perception enhancement
    ANZSRC Fields of Research
    47 - Language, communication and culture::4704 - Linguistics

    Related items

    Showing items related by title, author, creator and subject.

    • Listen with your skin: Aerotak speech perception enhancement system 

      Derrick, Donald; De Rybel T; O'Beirne, Greg A.; Hay J (ISCA, 2014)
      Here we introduce Aerotak: A system for audio analysis and perception enhancement that allows speech perceivers to listen with their skin. The current system extracts unvoiced portions of an audio signal representative of ...
    • Aero-tactile integration in Mandarin 

      Derrick, Donald; Heyne M; O'Beirne, Greg A.; Hay J (Australian Speech Science and Technology Association Inc., 2019)
      Previous research has shown that audio-aligned air puffs applied to the skin can enhance the perception of speech audio [12]. In this study, we applied dynamically varying air flow during two-way forced-choice ...
    • Aero-tactile integration during speech perception: Effect of response and stimulus characteristics on syllable identification 

      Derrick, Donald; Madappallimattam J; Theys C (Acoustical Society of America (ASA), 2019)
      Integration of auditory and aero-tactile information during speech perception has been documented during two-way closed-choice syllable classification tasks [Gick and Derrick (2009). Nature 462, 502–504], but not during ...
    Advanced Search

    Browse

    All of the RepositoryCommunities & CollectionsBy Issue DateAuthorsTitlesSubjectsThesis DisciplineThis CollectionBy Issue DateAuthorsTitlesSubjectsThesis Discipline

    Statistics

    View Usage Statistics
    • SUBMISSIONS
    • Research Outputs
    • UC Theses
    • CONTACTS
    • Send Feedback
    • +64 3 369 3853
    • ucresearchrepository@canterbury.ac.nz
    • ABOUT
    • UC Research Repository Guide
    • Copyright and Disclaimer
    • SUBMISSIONS
    • Research Outputs
    • UC Theses
    • CONTACTS
    • Send Feedback
    • +64 3 369 3853
    • ucresearchrepository@canterbury.ac.nz
    • ABOUT
    • UC Research Repository Guide
    • Copyright and Disclaimer