[audio.cpp] SoulX-FlashHead + LFM3-Audio + OWSM v4 = Real-Time Local Avatar Chat
, updated First seen Updated Limited coverage, tapering
Open weights
Reported by r/LocalLLaMA1 source ↓
Key points
- The prototype uses OWSM v4 for speech transcription and LFM3-Audio for responses and text-to-speech
- The reported 850-millisecond delay was measured on an RTX 5090
- The post recommends an RTX 4090 or better for SoulX-FlashHead video generation
- cuDNN is required for real-time performance; without it, inference is twice as slow and VRAM use doubles
- The speech-to-speech path has one voice, so LFM3-Audio is called again to synthesize a different voice
Sources
Details
The audio.cpp community post says the avatar chat is available to try in the WebUI in version 0.9.5. SoulX-FlashHead generates the talking-head video, OWSM v4 transcribes speech input, and LFM3-Audio produces conversational responses and speech output.
The post reports about 850 milliseconds between submitting a question and the avatar speaking on an RTX 5090, with speech recognition running in parallel. It says video generation is GPU-intensive and cuDNN is needed for real-time performance; without cuDNN, inference takes twice as long and uses twice the VRAM.
Written from coverage as of