Poster: Physically-Based Natural Hand and Tangible AR Interaction for Face-to-Face Collaboration on a Tabletop (2012)
Type of ContentConference Contributions - Published
PublisherUniversity of Canterbury. Human Interface Technology Laboratory
AuthorsPiumsomboon, T., Clark, A., Umakatsu, A., Billinghurst, M.show all
In this paper, we present an AR framework that allows natural hand and tangible AR interaction for physically-based interaction and environment awareness to support face-to-face collaboration using Microsoft Kinect. Our framework comprises of six major components: (1) marker tracking (2) depth acquisition (3) image processing (4) physics simulation (5) communication and (6) rendering. The resulting augmented environment supports occlusion, shadows, and physically-based interaction of real and virtual objects. We propose three methods of natural hand representations including mesh-based, direct sphere substitution and variational optical flow. A tabletop racing game and AR Sandbox applications are created based on this framework, showing the application possibilities.
CitationPiumsomboon, T., Clark, A., Umakatsu, A., Billinghurst, M. (2012) Poster: Physically-Based Natural Hand and Tangible AR Interaction for Face-to-Face Collaboration on a Tabletop. Costa Mesa, CA, USA: IEEE Symposium on 3D User Interfaces (3DUI), 4-5 Mar 2012. Proceedings, 155-156.
This citation is automatically generated and may be unreliable. Use as a guide only.
Keywordsaugmented reality; physically-based interaction; Kinect; physics engine; environment awareness; collaboration
ANZSRC Fields of Research08 - Information and Computing Sciences::0801 - Artificial Intelligence and Image Processing::080111 - Virtual Reality and Related Simulation
08 - Information and Computing Sciences::0806 - Information Systems::080602 - Computer-Human Interaction