University of Canterbury Home
    • Admin
    UC Research Repository
    UC Library
    JavaScript is disabled for your browser. Some features of this site may not work without it.
    View Item 
    1. UC Home
    2. Library
    3. UC Research Repository
    4. UC Research Centres
    5. NZ Institute of Language, Brain and Behaviour
    6. NZILBB: Conference Contributions
    7. View Item
    1. UC Home
    2.  > 
    3. Library
    4.  > 
    5. UC Research Repository
    6.  > 
    7. UC Research Centres
    8.  > 
    9. NZ Institute of Language, Brain and Behaviour
    10.  > 
    11. NZILBB: Conference Contributions
    12.  > 
    13. View Item

    Learning effects in multimodal perception with real and simulated faces (2019)

    Thumbnail
    View/Open
    Published version (1.434Mb)
    Type of Content
    Conference Contributions - Published
    UC Permalink
    https://hdl.handle.net/10092/18041
    
    Publisher's DOI/URI
    https://icphs2019.org/icphs2019-fullpapers/pdf/full-paper_913.pdf
    
    Publisher
    Australian Speech Science and Technology Association Inc.
    ISBN
    978-0-646-80069-1
    Collections
    • NZILBB: Conference Contributions [16]
    Authors
    Keough M
    Derrick, Donald cc
    Taylor RC
    Gick B
    show all
    Editors
    Calhoun S
    Escudero P
    Tabain M
    Warren P
    Abstract

    We have all learned to associate real voices with animated faces since childhood. Researchers use this association, employing virtual faces in audiovisual speech perception tasks. However, we do not know if perceivers treat those virtual faces the same as real faces, or if instead integration of speech cues from new virtual faces must be learned at the time of contact. We test this possibility using speech information that perceivers have never had a chance to associate with simulated faces – aerotactile somatosensation. With human faces, silent bilabial articulations (“ba” and “pa”), accompanied by synchronous cutaneous airflow, shift perceptual bias towards “pa”. If visual-tactile integration is unaffected by the visual stimuli’s ecological origin, results with virtual faces should be similar. Contra previous reports [8], our results show perceivers do treat computer-generated faces and human faces in a similar fashion - visually aligned cutaneous airflow shifts perceptual bias towards “pa” equally well with virtual and real faces.

    Citation
    Keough M, Derrick D, Taylor RC, Gick B (2019). Learning effects in multimodal perception with real and simulated faces. Melbourne: International Congress of the Phonetic Sciences 2019. 05/08/2019-09/08/2019. Proceedings of the 19th International Congress of Phonetic Sciences, Melbourne, Australia 2019. 1189-1192.
    This citation is automatically generated and may be unreliable. Use as a guide only.
    Keywords
    Speech Perception; Speech Acoustics; Multimodal Phonetics
    ANZSRC Fields of Research
    47 - Language, communication and culture::4704 - Linguistics

    Related items

    Showing items related by title, author, creator and subject.

    • Visual-tactile integration in speech perception : evidence for modality neutral speech primitives. 

      Bicevskis K; Derrick, Donald; Gick B (Acoustical Society of America (ASA), 2016)
      © 2016 Acoustical Society of America. Audio-visual [McGurk and MacDonald (1976). Nature 264, 746-748] and audio-tactile [Gick and Derrick (2009). Nature 462(7272), 502-504] speech stimuli enhance speech perception over ...
    • The temporal window of audio-tactile integration in speech perception 

      Gick B; Ikegami Y; Derrick, Donald (Acoustical Society of America (ASA), 2010)
      Asynchronous cross-modal information is integrated asymmetrically in audio-visual perception. To test whether this asymmetry generalizes across modalities, auditory (aspirated "pa" and unaspirated "ba" stops) and tactile ...
    • Three speech sounds, one motor action: Evidence for speech-motor disparity from English flap production 

      Derrick, Donald; Stavness, I.; Gick, B. (University of Canterbury. New Zealand Institute of Language, Brain & Behaviour, 2015)
      The assumption that units of speech production bear a one-to-one relationship to speech motor actions pervades otherwise widely varying theories of speech motor behavior. This speech produc- tion and simulation study ...
    Advanced Search

    Browse

    All of the RepositoryCommunities & CollectionsBy Issue DateAuthorsTitlesSubjectsThesis DisciplineThis CollectionBy Issue DateAuthorsTitlesSubjectsThesis Discipline

    Statistics

    View Usage Statistics
    • SUBMISSIONS
    • Research Outputs
    • UC Theses
    • CONTACTS
    • Send Feedback
    • +64 3 369 3853
    • ucresearchrepository@canterbury.ac.nz
    • ABOUT
    • UC Research Repository Guide
    • Copyright and Disclaimer
    • SUBMISSIONS
    • Research Outputs
    • UC Theses
    • CONTACTS
    • Send Feedback
    • +64 3 369 3853
    • ucresearchrepository@canterbury.ac.nz
    • ABOUT
    • UC Research Repository Guide
    • Copyright and Disclaimer