Using RGB-D sensors, we are able to scan a face and to transfer its movements to an avatar. These sensors allow us to capture the depth of the surface. Additionally, we can also use RGB cameras to track the eye movement and transfer them to the avatar. To achieve an even higher level of detail in the virtual representation, the VR glasses also include sensors that recognize eyebrow movement.
This project is sponsored by: German Federal Ministry of Education and Research (BMBF) under the project number 16SV8182 and 13FH022IX6. Project names: HIVE-Lab and Interactive body-near production technology 4.0 (German: Interaktive körpernahe Produktionstechnik 4.0 (iKPT4.0)).