Poster: Physically-Based Natural Hand and Tangible AR Interaction for Face-to-Face Collaboration on a Tabletop (2012)

Type of Content
Conference Contributions - PublishedPublisher
University of Canterbury. Human Interface Technology LaboratoryCollections
Abstract
In this paper, we present an AR framework that allows natural hand and tangible AR interaction for physically-based interaction and environment awareness to support face-to-face collaboration using Microsoft Kinect. Our framework comprises of six major components: (1) marker tracking (2) depth acquisition (3) image processing (4) physics simulation (5) communication and (6) rendering. The resulting augmented environment supports occlusion, shadows, and physically-based interaction of real and virtual objects. We propose three methods of natural hand representations including mesh-based, direct sphere substitution and variational optical flow. A tabletop racing game and AR Sandbox applications are created based on this framework, showing the application possibilities.
Citation
Piumsomboon, T., Clark, A., Umakatsu, A., Billinghurst, M. (2012) Poster: Physically-Based Natural Hand and Tangible AR Interaction for Face-to-Face Collaboration on a Tabletop. Costa Mesa, CA, USA: IEEE Symposium on 3D User Interfaces (3DUI), 4-5 Mar 2012. Proceedings, 155-156.This citation is automatically generated and may be unreliable. Use as a guide only.
Keywords
augmented reality; physically-based interaction; Kinect; physics engine; environment awareness; collaborationANZSRC Fields of Research
08 - Information and Computing Sciences::0801 - Artificial Intelligence and Image Processing::080111 - Virtual Reality and Related Simulation08 - Information and Computing Sciences::0806 - Information Systems::080602 - Computer-Human Interaction
Rights
“© © 2012 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.”Related items
Showing items related by title, author, creator and subject.
-
Grasp-Shell vs Gesture-Speech: A Comparison of Direct and Indirect Natural Interaction Techniques in Augmented Reality
Piumsomboon, T.; Altimira, D.; Kim, H.; Clark, A.; Lee, G.; Billinghurst, Mark (University of Canterbury. Human Interface Technology Laboratory, 2014)In order for natural interaction in Augmented Reality (AR) to become widely adopted, the techniques used need to be shown to support precise interaction, and the gestures used proven to be easy to understand and perform. ... -
Real-time Visual Representations for Mixed Reality Remote Collaboration
Gao L; Bai H; Piumsomboon T; Lee G; Lindeman RW; Billinghurst, Mark (2017)We present a prototype Mixed Reality (MR) system with a hybrid interface to support remote collaboration between a local worker and a remote expert in a large-scale work space. By combining a low-resolution 3D point-cloud ... -
Physically interactive tabletop augmented reality using the Kinect
Corbett-Davies, S.; Green, R.; Clark, A. (University of Canterbury. Computer Science and Software EngineeringUniversity of Canterbury. Human Interface Technology Laboratory, 2012)In this paper we present a method for allowing arbitrary objects to interact physically in an augmented reality (AR) environment. A Microsoft Kinect is used to track objects in 6 degrees of freedom, enabling realistic ...