Open Source
Explore the latest AI open-source projects from GitHub and HuggingFace.
Explore the latest AI open-source projects from GitHub and HuggingFace.
Spark-TTS is an efficient LLM-based text-to-speech system from the SparkAudio team, described in the paper *Spark-TTS: An Efficient LLM-Based Text-to-Speech Model with Single-Stream Decoupled Speech Tokens* (arXiv:2503.01710). Released under Apache-2.0 with the compact Spark-TTS-0.5B model, the repository has passed 10,000 GitHub stars. Its distinguishing idea is architectural simplicity: rather than bolting a separate acoustic generator onto a language model, Spark-TTS is built entirely on Qwen2.5 and reconstructs audio directly from the codes the LLM predicts. ## LLM-Native, Single-Stream Design Most modern TTS pipelines pair a token-predicting model with a separate flow-matching or diffusion module that turns those tokens into acoustic features. Spark-TTS removes that second stage. It uses BiCodec — single-stream decoupled speech tokens that separate linguistic content from speaker attributes — so the Qwen2.5 backbone can predict codes that are decoded straight back into waveform audio. Eliminating the extra generation model streamlines the system, reduces complexity, and improves efficiency, which is a large part of why a 0.5B model stays practical to run. ## Zero-Shot Voice Cloning and Bilingual Support Spark-TTS supports zero-shot voice cloning: given a short reference clip and its transcript, it replicates a speaker's voice without any speaker-specific training. It handles both Chinese and English and is designed for cross-lingual and code-switching scenarios, so a cloned voice can move between the two languages within a single utterance while keeping naturalness and speaker identity intact. ## Controllable Voice Creation Beyond cloning existing voices, Spark-TTS can synthesize entirely new virtual speakers from parameters. Users adjust attributes such as gender, pitch, and speaking rate to design a consistent voice with no reference audio at all. Both modes are exposed through a Gradio web UI — Voice Cloning (upload or record a reference) and Voice Creation (dial in the controls) — alongside a command-line interface for scripting. ## Deployment and Performance The 0.5B footprint keeps Spark-TTS light enough for consumer GPUs, and the project provides a reference deployment with Nvidia Triton Inference Server and TensorRT-LLM, with published benchmarks on a single L20 GPU for teams that need production throughput. Installation follows a standard Conda + pip flow, with model weights pulled from the Hugging Face Hub. ## Trade-offs and Limitations Language coverage is limited to Chinese and English, so other languages are unsupported. The repository is inference-focused — it ships the inference code and pretrained model rather than a full training pipeline — and has not seen a major update since early 2025, so it is best treated as a stable release rather than a fast-moving project. At 0.5B parameters it prioritizes efficiency over the absolute top-end quality of much larger TTS systems, and, as with any voice-cloning technology, it raises consent and misuse considerations that deployers must handle responsibly. ## Who Should Use This Spark-TTS is a good fit for developers who want an efficient, controllable, self-hostable zero-shot TTS with a small footprint for apps, voice agents, and content generation, and for researchers exploring LLM-native speech synthesis. It is particularly compelling when you need both voice cloning and parametric voice creation in English or Chinese without standing up heavy infrastructure.