Commercial Version
Commercial Version
7. Commercial Version
WeChat: wxwubug (please state your requirements when adding)
Email: lipku@foxmail.com
Telegram: https://t.me/livetalking
Commercial Demo Address: https://livetalking.top/
7.1 Upgraded Wav2Lip
The network structure of Wav2Lip has been upgraded and optimized; audio features are replaced with HuBERT; LSTM networks are introduced to establish correlation between preceding and subsequent frames.
192px and 384px models as well as integration code for LiveTalking are provided.
7.2 Digital Human Features
- Voice interaction: Supports synchronized subtitles and event notifications for the start and end of digital human speech; wake word interruption for ongoing speech is available.
- Vue-based client with transparent background support, enabling dynamic background switching for digital humans.
- Real-time audio stream input: Suitable for feeding real-time audio streams from external sources (e.g., audio-output large language models) to the digital human for live voice broadcast.
- Action switching: You can assign a specific action via the human API when triggering digital human speech, so the avatar performs the designated action while talking.
Additional Exclusive Features:
- Python Client
Features an independent video display window and Python interaction APIs, ideal for integration into Python projects such as live streaming workflows. Demo Video - Multi-Avatar Concurrent Display
Multiple digital humans can converse simultaneously within a single viewport. Each avatar’s speech and corresponding voice timbre can be designated via API. Demo Video - Camera-Driven Avatar Motions & Expressions
Streamers can make facial expressions and body movements in front of a camera without speaking; the API synchronizes lip movements to match the streamer’s facial gestures. - LiveKit Integration
Seamlessly embed digital humans into LiveKit rooms. Demo Video
7.3 Other Offerings
- Digital Human Management System
Covers management of avatar characters, TTS voice synthesis, and motion choreography. Includes user menu configuration and API access permission controls. - Training & fine-tuning scripts plus training datasets for the upgraded Wav2Lip model
- Dedicated digital human live streaming software