Section: Scientific Foundations

Realistic 3D Face Reconstruction and Face Tracking

Participants : Daria Kalinkina, André Gagalowicz.

The 3D reconstruction of a realistic face model from a small set of images is one of the greatest challenges in the field of audio-visual post-production and special effects generation. Previously manual, 3D object tracking is becoming more and more automated. We are working on human faces, which are one of the most difficult entities to track because of their complex deformations. In order to perform a high quality tracking, we developed a technique to model precisely a 3D mesh of a face from a small set of images only. They may be taken from a video sequence. This model, first constructed in a neutral expression, is then animated for tracking purposes.