MuseTalk Quick Start
Both LLM and TTS use cloud APIs. The 2D avatar uses MuseTalk for inference (GPU only).
Handlers Used
| Type | Handler | Reference |
|---|---|---|
| Client | client/rtc_client/client_handler_rtc | RTC Client |
| VAD | vad/silerovad/vad_handler/silero | |
| ASR | asr/sensevoice/asr_handler_sensevoice | |
| LLM | llm/openai_compatible/llm_handler/llm_handler_openai_compatible | OpenAI Compatible |
| TTS | tts/bailian_tts/tts_handler_cosyvoice_bailian | Bailian CosyVoice |
| Avatar | avatar/musetalk/avatar_handler_musetalk | MuseTalk |
Quick Start
bash
uv run install.py --config config/chat_with_openai_compatible_bailian_cosyvoice_musetalk.yaml
uv run scripts/download_models.py --handler musetalk
uv run src/demo.py --config config/chat_with_openai_compatible_bailian_cosyvoice_musetalk.yaml