Evaluating the Effects of Hand-gesture-based Interaction with Virtual Content in a 360 Movie

Type of content
Conference Contributions - Published
Publisher's DOI/URI
Thesis discipline
Degree name
Publisher
Journal Title
Journal ISSN
Volume Title
Language
Date
2017
Authors
Khan H
Lee G
Hoermann S
Clifford R
Billinghurst, Mark
Lindeman RW
Abstract

Head-mounted displays are becoming increasingly popular as home entertainment devices for viewing 360 movies. This paper explores the effects of adding gesture interaction with virtual content and two different hand-visualisation modes for 360 movie watching experience. The system in the study comprises of a Leap Motion sensor to track the user’s hand and finger motions, in combination with a SoftKinetic RGB-D camera to capture the texture of the hands and arms. A 360 panoramic movie with embedded virtual objects was used as content. Four conditions, displaying either a point-cloud of the real hand or a rigged computer-generated hand, with and without interaction, were evaluated. Presence, agency, embodiment, and ownership, as well as the overall participant preference were measured. Results showed that participants had a strong preference for the conditions with interactive virtual content, and they felt stronger embodiment and ownership. The comparison of the two hand visualisations showed that the display of the real hand elicited stronger ownership. There was no overall difference for presence between the four conditions. These findings suggest that adding interaction with virtual content could be beneficial to the overall user experience, and that interaction should be performed using the real hand visualisation instead of the virtual hand if higher ownership is desired.

Description
Citation
Khan H, Lee G, Hoermann S, Clifford R, Billinghurst M, Lindeman RW (2017). Evaluating the Effects of Hand-gesture-based Interaction with Virtual Content in a 360 Movie. ICAT-EGVE 2017 - International Conference on Artificial Reality and Telexistence & Eurographics Symposium on Virtual Environments.
Keywords
Information Interfaces and Presentation, Multimedia Information Systems - Artificial, Augmented, and Virtual Realities, Computer Graphics, Three-Dimensional Graphics and Realism - Virtual Reality
Ngā upoko tukutuku/Māori subject headings
ANZSRC fields of research
Field of Research::08 - Information and Computing Sciences::0801 - Artificial Intelligence and Image Processing::080111 - Virtual Reality and Related Simulation
Field of Research::08 - Information and Computing Sciences::0801 - Artificial Intelligence and Image Processing::080103 - Computer Graphics
Rights