The enhancement of reality with synthetic images allows us to perform tasks more easily, such as the collaboration between people who are at different locations. Collaborative manufacturing, assembly tasks or education can be conducted remotely, even if the collaborators do not meet physically. In a project, called “Collaborative Mesh Modeling”, we extended our immersive modelling application “ClayMoreVR” with the ability to communicate with other Mixed Reality devices. Mixed Reality encompasses Augmented Reality as well as Virtual Reality devices and allows for combining the advantages of both technologies.

The video shows a prototype with two co-located worker, but a similar scenario is possible with distributed workers around the world. The worker, who wears the HTC Vive, creates a server. A remote worker with a Microsoft HoloLens scans a fiducial marker (the marker with the text “HIRO” on it) which contains the IP address of the server of the worker, who is using the HTC Vive. The HoloLens connects to the server of the HTC Vive user. Furthermore, the marker serves as a visual matching point between the two tracking technologies of the HTC Vive and the HoloLens and allows an aligned space between both systems.


Philipp Ladwig