Open Source
Explore the latest AI open-source projects from GitHub and HuggingFace.
Explore the latest AI open-source projects from GitHub and HuggingFace.
Chatterbox is Resemble AI's family of state-of-the-art open-source text-to-speech models, built for low-latency, production-grade voice applications. Released under the permissive MIT license, it has become one of the most popular open TTS projects on GitHub with over 25,000 stars — a position it earned by pairing genuinely competitive voice quality with a commercial-friendly license and an unusual built-in feature: imperceptible neural watermarking on every generated clip. Where many open TTS systems force a choice between quality, speed, and licensing, Chatterbox aims to deliver all three.
Chatterbox is not a single model but a family tuned for different needs:
| Model | Size | Primary Use |
|---|---|---|
| Chatterbox-Turbo | 350M params | English voice agents, low-latency production |
| Chatterbox-Multilingual V3 | 500M params | 23+ languages, global applications |
| Single Language Pack | 500M each | Six dedicated finetunes for specific languages |
| Original Chatterbox | 500M params | English with creative controls |
The Turbo variant is the speed-focused member, while the Multilingual V3 model and the per-language finetunes target broad linguistic coverage and quality.
Chatterbox clones a voice from a short reference audio clip without any per-speaker training, generating new speech in the target timbre on demand.
A configurable exaggeration parameter (on a 0-1 scale) lets developers dial speech from neutral to dramatic; the maintainers recommend around 0.7 for expressive delivery. The Turbo model additionally understands paralinguistic tags such as [cough], [laugh], and [chuckle], inserting natural non-verbal sounds inline.
Every Chatterbox output carries a Perth neural watermark — described as imperceptible and robust enough to survive MP3 compression. The watermark can be extracted with the perth library, giving deployers a provenance signal for responsibly tracing synthetic audio.
Chatterbox-Turbo replaces a ten-step mel decoder with a single-step decoder, cutting generation overhead and enabling sub-200ms latency in production API settings — fast enough for interactive voice agents.
Classifier-free guidance weighting (default 0.5) provides an additional knob for balancing fidelity to the prompt against naturalness, and V3 reduces hallucination relative to earlier versions.
Chatterbox-Multilingual V3 covers 23+ languages, including Arabic, Danish, German, Greek, English, Spanish, Finnish, French, Hebrew, Hindi, Italian, Japanese, Korean, Malay, Dutch, Norwegian, Polish, Portuguese, Russian, Swedish, Swahili, Turkish, and Chinese. For teams that need maximum quality in a specific language, the Single Language Pack offers six dedicated finetunes.
Getting started is a single pip command:
pip install chatterbox-tts
The project requires Python 3.11+ with dependencies pinned in pyproject.toml, and exposes a straightforward Python API for synthesis, voice cloning, and watermark extraction.
Resemble AI evaluated Chatterbox-Turbo through the Podonos listening-test platform against leading commercial and open systems, including ElevenLabs Turbo v2.5, Cartesia Sonic 3, and VibeVoice 7B — positioning a 350M open model directly against proprietary services many times its size.
The combination of MIT licensing, production-grade latency, and built-in watermarking is rare in open TTS. The MIT license removes the commercial-use ambiguity that limits several otherwise-capable open models; the Turbo architecture makes self-hosted real-time voice agents practical without a GPU farm; and the Perth watermark bakes provenance into the output by default rather than leaving it as an afterthought. Together these make Chatterbox a realistic foundation for shipping voice products, not just for experimentation.
The creative controls reward tuning — exaggeration and CFG values that work for one voice or language may need adjustment for another, so getting consistent output across a large catalog takes experimentation. Coverage and quality vary across the 23+ supported languages, with the best results concentrated in English and the dedicated single-language finetunes. And as with any high-fidelity zero-shot cloning system, the voice-cloning capability carries clear potential for misuse — the built-in watermark mitigates but does not eliminate that risk, and deployers remain responsible for obtaining consent and honoring the watermark signal.