Team, Visitors, External Collaborators
Overall Objectives
Research Program
Application Domains
Highlights of the Year
New Software and Platforms
New Results
Bilateral Contracts and Grants with Industry
Partnerships and Cooperations
XML PDF e-pub
PDF e-Pub

Section: New Software and Platforms


Visualization of multimodal speech data

Keywords: Data visualization - 3D movement - Speech processing - Videos

Scientific Description: VisArtico is a visualization software of multimodal data. It is possible to visualize the positions of real or virtual sensors and to animate them simultaneously with acoustics. This software can be useful for researchers in speech production, audiovisual speech synthesis or articulatory speech analysis.

Functional Description: VisArtico is a user-friendly software which allows visualizing multimodal data acquired by several systems: an articulograph, motion capture system, depth camera. This visualization software has been designed so that it can directly use the data provided by the different systems to display the spatial and temporal positions of the sensors (real and virtual). Moreover, VisArtico allows viewing the sensors augmented with visual information by indicating graphically the data for the tongue, lips and jaw.

Release Functional Description: The current version allows the user to manage different modalities (articulatory, gestural, acoustic and video). It is possible to do automatic alignment, or even speech recognition. Several spatial data processing tools have been added (referential change, head movement suppression, merging data from multiple sources, ...).

News Of The Year: The software has undergone several improvements. Mainly, several branches have been merged in order to have as many features as possible available within the master branch.