Natural Gesture Based Interaction for Handheld Augmented Reality (2013)

Type of Content
Theses / DissertationsThesis Discipline
Computer ScienceDegree Name
Master of SciencePublisher
University of Canterbury. Computer Science and Software EngineeringCollections
Abstract
The goal of this research thesis is to explore and evaluate a novel interaction interface performing canonical manipulations in 3D space for Augmented Reality (AR) on handheld devices. Different from current handheld AR applications usually using touch-screen based interaction methods, we developed a 3D gesture based interaction approach for handheld AR using an attached RGB-Depth camera to provide intuitive 3D interaction experience in 3D space. By identifying fingertips and mapping their 3D positions into the coordinate system of AR virtual scene, our proposed method allows users to perform operations on virtual objects using their fingers in midair with six-degrees-of-freedom (6DOF). We applied our methods in two systems: (1) a client-server handheld AR system, and (2) a standalone handheld tablet AR system. In order to evaluate the usability of our gesture-based interface we conducted a user study in which we compared the performance to a 2D touch-based interface. From the results, we concluded that traditional 2D touch-based interface performed faster than our proposed 3D gesture-based interface. However, our method proved a high entertainment value, suggesting great possibilities for leisure applications.
Keywords
Augmented Reality (AR); Natural gesture based interaction; Handheld deviceRights
Copyright Lei GaoRelated items
Showing items related by title, author, creator and subject.
-
Freeze view touch and finger gesture based interaction methods for handheld augmented reality interfaces
Bai, H.; Lee, G.A.; Billinghurst, Mark (University of Canterbury. Human Interface Technology Laboratory, 2012)Interaction techniques for handheld mobile Augmented Reality (AR) often focus on device-centric methods based around touch input. However, users may not be able to easily interact with virtual objects in mobile AR scenes ... -
Interaction Techniques using Head Mounted Displays and Handheld Devices for Outdoor Augmented Reality
Budhiraja, Rahul (University of Canterbury. Human Interface Technology Lab NZ, 2013)Depending upon their nature, Outdoor AR applications can be deployed on head mounted displays (HMD) like Google glass or handheld Displays (HHD) like smartphones. This master’s thesis investigates novel gesture-based ... -
Grasp-Shell vs Gesture-Speech: A Comparison of Direct and Indirect Natural Interaction Techniques in Augmented Reality
Piumsomboon, T.; Altimira, D.; Kim, H.; Clark, A.; Lee, G.; Billinghurst, Mark (University of Canterbury. Human Interface Technology Laboratory, 2014)In order for natural interaction in Augmented Reality (AR) to become widely adopted, the techniques used need to be shown to support precise interaction, and the gestures used proven to be easy to understand and perform. ...