Gesturing with arms, hands and fingers is a natural part of conversations. That is why we have developed a system that is able to track finger movement with a high accuracy. This allows users of mixed reality to have a virtual conversation without having to forgo complex gestures.

This system can also be used for novel interactions, such as performing micro gestures or 'on-body interaction'. Micro gestures are subtil movements which can be used for controlling an user interface. Possible use cases could be a music volume slider which can be driven by only sliding with the thumb on the side of the index finger. This interaction represents not only a micro gesture, but also an on-body interaction. The following video shows our hand tracking systems in action:

Contact: Bastian Dewitz & Philipp Ladwig

Videos: