Accéder directement au contenu Accéder directement à la navigation
Article dans une revue

Real-time computer vision system for tracking simultaneously subject-specific rigid head and non-rigid facial mimic movements using a contactless sensor and system of systems approach

Abstract : Background and Objective: Head and facial mimic animations play important roles in various fields such as human-machine interactions, internet communications, multimedia applications, and facial mimic analysis. Numerous studies have been trying to simulate these animations. However, they hardly achieved all requirements of full rigid head and non-rigid facial mimic animations in a subject-specific manner with real-time framerates. Consequently, this present study aimed to develop a real-time computer vision system for tracking simultaneously rigid head and non-rigid facial mimic movements. Methods: Our system was developed using the system of systems approach. A data acquisition sub-system was implemented using a contactless Kinect sensor. A subject-specific model generation sub-system was designed to create the geometrical model from the Kinect sensor without texture information. A subject-specific texture generation sub-system was designed for enhancing the reality of the generated model with texture information. A head animation sub-system with graphical user interfaces was also developed. Model accuracy and system performances were analyzed. Results: The comparison with MRI-based model shows a very good accuracy level (distance deviation of similar to 1 mm in neutral position and an error range of [2-3 mm] for different facial mimic positions) for the generated model from our system. Moreover, the system speed can be optimized to reach a high framerate (up to 60 fps) during different head and facial mimic animations. Conclusions: This study presents a novel computer vision system for tracking simultaneously subject-specific rigid head and non-rigid facial mimic movements in real time. In perspectives, serious game technology will be integrated into this system towards a full computer-aided decision support system for facial rehabilitation. (C) 2020 Elsevier B.V. All rights reserved.
Type de document :
Article dans une revue
Liste complète des métadonnées

https://hal-u-picardie.archives-ouvertes.fr/hal-03599052
Contributeur : Louise DESSAIVRE Connectez-vous pour contacter le contributeur
Soumis le : dimanche 6 mars 2022 - 15:58:39
Dernière modification le : dimanche 4 septembre 2022 - 18:10:27

Lien texte intégral

Identifiants

Citation

Tan-Nhu Nguyen, Stéphanie Dakpé, Marie-Christine Ho Ba Tho, Tien-Tuan Dao. Real-time computer vision system for tracking simultaneously subject-specific rigid head and non-rigid facial mimic movements using a contactless sensor and system of systems approach. Computer Methods and Programs in Biomedicine, Elsevier, 2020, 191, ⟨10.1016/j.cmpb.2020.105410⟩. ⟨hal-03599052⟩

Partager

Métriques

Consultations de la notice

19