Physically interactive tabletop augmented reality using the Kinect

Simple item page
dc.contributor.authorCorbett-Davies, S.
dc.contributor.authorGreen, R.
dc.contributor.authorClark, A.
dc.date.accessioned2014-01-28T23:03:18Z
dc.date.available2014-01-28T23:03:18Z
dc.date.issued2012en
dc.description.abstractIn this paper we present a method for allowing arbitrary objects to interact physically in an augmented reality (AR) environment. A Microsoft Kinect is used to track objects in 6 degrees of freedom, enabling realistic interaction between them and virtual content in an tabletop AR context. We propose a point cloud based method for achieving such interaction. An adaptive per-pixel depth threshold is used to extract foreground objects, which are grouped using connected-component analysis. Objects are tracked with a variant of the Iterative Closest Point algorithm, which uses randomised projective correspondences. Our algorithm tracks objects moving at typical tabletop speeds with median drifts of 8:5% (rotational) and 4:8% (translational). The point cloud representation of foreground objects is improved as additional views of the object are visible to the Kinect. Physics-based AR interaction is achieved by fitting a collection of spheres to the point cloud model and passing them to the Bullet physics engine as a physics proxy of the object. Our method is demonstrated in an AR application where the user can interact with a virtual tennis ball, illustrating our proposed method's potential for physics-based AR interaction.en
dc.identifier.citationCorbett-Davies, S., Green, R., Clark, A. (2012) Physically interactive tabletop augmented reality using the Kinect. Dunedin, New Zealand: 27th International Conference on Image and Vision Computing New Zealand (IVCNZ '12), 26-28 Nov 2012. Proceedings:, 210-215.en
dc.identifier.doihttps://doi.org/10.1145/2425836.2425880
dc.identifier.urihttp://hdl.handle.net/10092/8836
dc.language.isoen
dc.publisherUniversity of Canterbury. Computer Science and Software Engineeringen
dc.publisherUniversity of Canterbury. Human Interface Technology Laboratoryen
dc.rights.urihttps://hdl.handle.net/10092/17651en
dc.subjectaugmented realityen
dc.subjectinteractionen
dc.subjectphysical simulationen
dc.subject.anzsrcField of Research::08 - Information and Computing Sciences::0801 - Artificial Intelligence and Image Processingen
dc.subject.anzsrcField of Research::08 - Information and Computing Sciences::0803 - Computer Softwareen
dc.subject.anzsrcField of Research::08 - Information and Computing Sciences::0806 - Information Systems::080602 - Computer-Human Interactionen
dc.titlePhysically interactive tabletop augmented reality using the Kinecten
dc.typeConference Contributions - Published
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
12643310_428reportIVCNZ.pdf
Size:
1.03 MB
Format:
Adobe Portable Document Format
Download
Collections
Engineering: Conference Contributions