Real-time Visual Representations for Mixed Reality Remote Collaboration

Type of content
Conference Contributions - Published
Publisher's DOI/URI
Thesis discipline
Degree name
Journal Title
Journal ISSN
Volume Title
Gao L
Bai H
Piumsomboon T
Lee G
Lindeman RW
Billinghurst, Mark

We present a prototype Mixed Reality (MR) system with a hybrid interface to support remote collaboration between a local worker and a remote expert in a large-scale work space. By combining a low-resolution 3D point-cloud of the environment surrounding the local worker with a high-resolution real-time view of small focused details, the remote expert can see a virtual copy of the local workspace with an independent viewpoint control. Meanwhile, the export can also check the current actions of the local worker through a real-time feedback view. We conducted a pilot study to evaluate the usability of our system by comparing the performance of three different interface designs (showing the real-time view in forms of 2D first-person view, a 2D third-person view and a 3D point cloud view). We found no difference in average task performance time between the three interfaces, but there was a difference in user preference.

Gao L, Bai H, Piumsomboon T, Lee G, Lindeman RW, Billinghurst M (2017). Real-time Visual Representations for Mixed Reality Remote Collaboration. ICAT-EGVE 2017 - International Conference on Artificial Reality and Telexistence & Eurographics Symposium on Virtual Environments.
Human-centered computing, Mixed / augmented reality, Virtual reality, Collaborative and social computing design and evaluation methods
Ngā upoko tukutuku/Māori subject headings
ANZSRC fields of research
Field of Research::08 - Information and Computing Sciences::0801 - Artificial Intelligence and Image Processing::080111 - Virtual Reality and Related Simulation
Field of Research::08 - Information and Computing Sciences::0806 - Information Systems::080602 - Computer-Human Interaction
Fields of Research::47 - Language, communication and culture::4701 - Communication and media studies::470102 - Communication technology and digital media studies