The Impact of Multi-sensory Stimuli on Confidence Levels for Perceptual-cognitive Tasks in VR

Type of content
Conference Contributions - Published
Thesis discipline
Degree name
Publisher
IEEE
Journal Title
Journal ISSN
Volume Title
Language
Date
2020
Authors
Jung S
Wood AL
Hoermann S
Abhayawardhana PL
Lindeman RW
Abstract

© 2020 IEEE. Supporting perceptual-cognitive tasks is an important part of our daily lives. We use rich, multi-sensory feedback through sight, sound, touch, smell, and taste to support better perceptual-cognitive things we do, such as sports, cooking, and searching for a location, and to increase our confidence in performing those tasks in daily life. Same with real life, the demand for perceptual-cognitive tasks exists in serious VR simulations such as surgical or safety training systems. However, in contrast to real life, VR simulations are typically limited to visual and auditory cues, while sometimes adding simple tactile feedback. This could make it difficult to make confident decisions in VR.In this paper, we investigate the effects of multi-sensory stimuli, namely visuals, audio, two types of tactile (floor vibration and wind), and smell in terms of the confidence levels on a location-matching task which requires a combination of perceptual and cognitive work inside a virtual environment. We also measured the level of presence when participants visited virtual places with different combinations of sensory feedback. Our results show that our multi-sensory VR system was superior to a typical VR system (vision and audio) in terms of the sense of presence and user preference. However, the subjective confidence levels were higher in the typical VR system.

Description
Citation
Jung S, Wood AL, Hoermann S, Abhayawardhana PL, Lindeman RW (2020). The Impact of Multi-sensory Stimuli on Confidence Levels for Perceptual-cognitive Tasks in VR. 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 22/03/2020-26/03/2020. Proceedings - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces, VR 2020. 463-472.
Keywords
Multisensory VR, perception, confidence, cognition, floor vibration, wind, smell
Ngā upoko tukutuku/Māori subject headings
ANZSRC fields of research
Fields of Research::46 - Information and computing sciences::4607 - Graphics, augmented reality and games::460708 - Virtual and mixed reality
Fields of Research::46 - Information and computing sciences::4607 - Graphics, augmented reality and games::460799 - Graphics, augmented reality and games not elsewhere classified
Rights
All rights reserved unless otherwise stated, ©2020 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.