Evaluating the Effects of Hand-gesture-based Interaction with Virtual Content in a 360 Movie (2017)

View/ Open
Type of Content
Conference Contributions - PublishedCollections
Abstract
Head-mounted displays are becoming increasingly popular as home entertainment devices for viewing 360 movies. This paper explores the effects of adding gesture interaction with virtual content and two different hand-visualisation modes for 360 movie watching experience. The system in the study comprises of a Leap Motion sensor to track the user’s hand and finger motions, in combination with a SoftKinetic RGB-D camera to capture the texture of the hands and arms. A 360 panoramic movie with embedded virtual objects was used as content. Four conditions, displaying either a point-cloud of the real hand or a rigged computer-generated hand, with and without interaction, were evaluated. Presence, agency, embodiment, and ownership, as well as the overall participant preference were measured. Results showed that participants had a strong preference for the conditions with interactive virtual content, and they felt stronger embodiment and ownership. The comparison of the two hand visualisations showed that the display of the real hand elicited stronger ownership. There was no overall difference for presence between the four conditions. These findings suggest that adding interaction with virtual content could be beneficial to the overall user experience, and that interaction should be performed using the real hand visualisation instead of the virtual hand if higher ownership is desired.
Citation
Khan H, Lee G, Hoermann S, Clifford R, Billinghurst M, Lindeman RW (2017). Evaluating the Effects of Hand-gesture-based Interaction with Virtual Content in a 360 Movie. ICAT-EGVE 2017 - International Conference on Artificial Reality and Telexistence & Eurographics Symposium on Virtual Environments.This citation is automatically generated and may be unreliable. Use as a guide only.
Keywords
Information Interfaces and Presentation; Multimedia Information Systems - Artificial, Augmented, and Virtual Realities; Computer Graphics; Three-Dimensional Graphics and Realism - Virtual RealityANZSRC Fields of Research
08 - Information and Computing Sciences::0801 - Artificial Intelligence and Image Processing::080111 - Virtual Reality and Related Simulation08 - Information and Computing Sciences::0801 - Artificial Intelligence and Image Processing::080103 - Computer Graphics
Related items
Showing items related by title, author, creator and subject.
-
The Effect of User Embodiment in AV Cinematic Experience
Chen J; Lee G; Billinghurst, Mark; Lindeman RW; Bartneck, Christoph (2017)Virtual Reality (VR) is becoming a popular medium for viewing immersive cinematic experiences using 360◦ panoramic movies and head mounted displays. There are previous research on user embodiment in real-time rendered ... -
Exploring Spatial Scale Perception in Immersive Virtual Reality for Risk Assessment in Interior Design.
Zhang J; Piumsomboon T; Dong Z; Bai X; Hoermann S; Lindeman R (ACM, 2020)One of the utilities of Virtual Reality is to provide its users with new perspectives, which is a promising application for architectural and interior design. In this paper, we investigate the effects of varying spatial ... -
In-Place Sketching for content authoring in Augmented Reality games
Hagbi, N.; Grasset, R.; Bergig, O.; Billinghurst, Mark; El-Sana, J. (University of Canterbury. Human Interface Technology Laboratory, 2010)Sketching leverages human skills for various purposes. In-Place Augmented Reality Sketching experiences build on the intuitiveness and flexibility of hand sketching for tasks like content creation. In this paper we ...