Chatterbox: Open Text-to-Speech with Voice Cloning

Chatterbox is Resemble AI's production-grade open source text-to-speech family, published at ResembleAI/chatterbox. From a short reference clip it clones a voice zero-shot, and it includes an emotion exaggeration control that dials expressiveness up or down independently of the text. The multilingual checkpoints extend the same zero-shot cloning across 23 languages including Arabic, Chinese, French, German, Hindi, Japanese, Korean, Portuguese, Russian, Spanish, and Swahili.

Overview

The core model pairs a 0.5B-parameter Llama-style autoregressive backbone with the S3Gen token-to-waveform generator and a compact voice encoder that conditions generation on the reference speaker. Training on roughly half a million hours of cleaned speech, combined with alignment-informed inference, keeps long generations stable with little of the drift, repetition, or skipped words that plague autoregressive TTS. Two creative controls set Chatterbox apart: an exaggeration slider that pushes delivery from flat narration to dramatic performance, and a classifier-free guidance weight that trades pacing against adherence, so a fast-talking reference can be slowed into deliberate speech.

Key Features

• Zero-shot voice cloning - A few seconds of reference audio is enough to synthesize new speech in that voice, with no fine-tuning
• Emotion exaggeration control - A single parameter scales expressive intensity
• Multilingual synthesis - The multilingual checkpoint speaks 23 languages and supports cross-language cloning, where a voice recorded in one language speaks another
• Turbo variant with paralinguistic tags - The faster Turbo checkpoint renders inline tags such as laughs, sighs, gasps, and throat-clearing for natural conversational delivery
• Voice conversion - A dedicated conversion pipeline re-voices existing recordings into a target speaker
• Stable long-form generation - Alignment-informed inference keeps output on-script for agent, narration, and video workloads

Use Cases

• Voice agents and conversational AI that need low-latency, consistent speech
• Narration for videos, games, memes, and audiobooks in a cloned or house voice
• Localization: one recorded voice speaking all 23 supported languages
• Multi-speaker dialog synthesis for drama, podcasts, and game NPCs
• Re-voicing existing audio through voice conversion
• Accessibility tools and screen-reader-quality reading voices

On This Template

The template serves Chatterbox through ComfyUI with the FL ChatterBox node pack preinstalled and every checkpoint pre-downloaded: standard English TTS, the 23-language multilingual model, the Turbo model with paralinguistic tag support, and the voice conversion model. Three ready-made workflows are preloaded, one each for English, multilingual, and Turbo synthesis. Each runs immediately with the built-in reference voice; connect any short audio clip to the optional audio prompt input to clone a voice instead. Dialog and voice conversion nodes from the same pack are available to wire in without downloading anything else. As in Resemble AI's own release, every generated clip carries Resemble AI's imperceptible Perth watermark, which lets the audio be identified as AI-generated.