Gesturing with arms, hands and fingers is a natural part of conversations. That is why we have developed a system that is able to track finger movement with a high accuracy. This allows users of mixed reality to have a virtual conversation without having to forgo complex gestures.

This system can also be used for novel interactions, such as performing micro gestures or 'on-body interaction'. Micro gestures are subtil movements which can be used for controlling an user interface. Possible use cases could be a music volume slider which can be driven by only sliding with the thumb on the side of the index finger. This interaction represents not only a micro gesture, but also an on-body interaction. The following video shows our hand tracking systems in action:

Contact: Bastian Dewitz & Philipp Ladwig

Videos:


Acknowledgements:

This project is sponsored by: German Federal Ministry of Education and Research (BMBF) under the project number 16SV8182 and 13FH022IX6. Project names: HIVE-Lab and Interactive body-near production technology 4.0 (German: Interaktive körpernahe Produktionstechnik 4.0 (iKPT4.0)).