Hand gesture-based interaction in an immersive cinematic environment (2017)

View/ Open
Type of Content
Theses / DissertationsThesis Discipline
Human Interface TechnologyDegree Name
Master of EngineeringPublisher
University of CanterburyLanguage
EnglishCollections
Abstract
With cheaper head-mounted displays (HMDs) available in the consumer market, new virtual reality (VR) applications are being explored, one such being interactive VR movies. In conventional movies, the user passively watches a movie on a 2D screen and the level of immersion depends on the narrative of the story. In VR, the user's field of view is covered by the digital content, thus interaction with the digital content can affect the user's immersion in the virtual environment. This thesis explores how hand gesturebased interaction and hand appearance affect the user's immersion and embodiment in a 360 VR movie.
A prototype was developed by combining a Leap Motion controller and a SoftKinetic RGB-D camera. It captures the user's real hands and blends them into the virtual environment. The prototype also supports natural interaction with the virtual environment. A user experiment was conducted using the prototype to investigate the effect of handbased interaction and hand appearance on the user's immersion and embodiment. There are two conditions for the hand appearance: the real hand, and the virtual hand. There are also two conditions for the hand-based interaction: with interaction, and without interaction.
Results showed that the real hand increased the user's embodiment in a 360 VR movie. However, hand appearance did not have any effect on the user's presence. It was found that having hand-based interaction increases the user's embodiment in the 360 VR movie. Similarly, it also displayed no effect on the user's presence. User feedback collected from the study identifies the limitations of the study and the system.
Rights
All Right ReservedRelated items
Showing items related by title, author, creator and subject.
-
Evaluating the Effects of Hand-gesture-based Interaction with Virtual Content in a 360 Movie
Khan H; Lee G; Hoermann S; Clifford R; Billinghurst, Mark; Lindeman RW (2017)Head-mounted displays are becoming increasingly popular as home entertainment devices for viewing 360 movies. This paper explores the effects of adding gesture interaction with virtual content and two different ... -
Mobile Augmented Reality: Free-hand Gesture-based Interaction
Bai, Huidong (University of Canterbury, 2016)The primary goal of this thesis is to design, implement and evaluate novel interaction techniques for enhancing Augmented Reality (AR) on mobile platforms. The motivation for this research comes from the need for more ... -
Freeze view touch and finger gesture based interaction methods for handheld augmented reality interfaces
Bai, H.; Lee, G.A.; Billinghurst, Mark (University of Canterbury. Human Interface Technology Laboratory, 2012)Interaction techniques for handheld mobile Augmented Reality (AR) often focus on device-centric methods based around touch input. However, users may not be able to easily interact with virtual objects in mobile AR scenes ...