LipSync Generator
- Creator: Utrecht University Virtual Human Controller email
- Publisher: Rage project
- Owner: Utrecht University email
LipSync Generator generates lip-synchronized speech animation for the game characters given text as input.
Short non-technical description: LipSync Generator is implemented as a Unity 3D plug-in. The component works together with a Text-to-Speech (TTS) system. Since Unity 3D is multi-platform, the component can be deployed on different platforms including Web and mobile applications.
Technical description: The component takes as input text, sends it to the text-to-speech (TTS) system, parses the phonemes, maps them to visemes (visual counterparts of phonemes) and finally blends them for smooth speech animation. It currently uses an off-the-shelf text-to-speech (CereVoice) library. It is also possible to link it with other TTS systems. The component provides a state-of-the-art co-articulation algorithm to generate natural lip-sync animation for game characters.
Language: English
Download: LipSync-Generator.zip
Source code:
Documentation:
Setup files:
Game development environment: Unity
Target platform: Windows
Programming language: C#
Version: 0.1
Version notes: Initial version
Development status: Completed
Commit URL: https://github.com/uu-rage/Lipsync-Generator
Type: Apache 2.0 (Apache License 2.0)
