AIAny
AI Audio2026
Icon for item

MOSS-TTS Family

Generates high‑fidelity, expressive speech and environmental sounds from text. The MOSS‑TTS Family provides specialized models for long‑form TTS, multi‑speaker dialogue, voice design and realtime streaming, plus torch‑free inference paths (llama.cpp / ONNX) and Hugging Face releases.

Introduction

Production text‑to‑speech rarely comes from a single model: long stability, expressive dialogue, voice design, sound effects and low‑latency streaming impose different tradeoffs. The MOSS‑TTS Family intentionally splits those responsibilities across complementary models and a shared discrete audio interface so teams can compose pipelines for research or production without rebuilding every component.

What Sets It Apart
  • Unified discrete audio interface: the MOSS‑Audio‑Tokenizer (a causal RVQ‑based tokenizer) provides a single compressed audio representation for all family members, simplifying composition between voice design, TTS, dialogue and sound‑effect modules.
  • Multi‑model family design: each model targets a clear production niche — MossTTSDelay (8B) for long, stable zero‑shot cloning and throughput, MossTTSLocal (1.7B) for lightweight/streaming scenarios, MossTTSRealtime for low‑latency multi‑turn agents, MOSS‑VoiceGenerator for text‑only voice design, MOSS‑SoundEffect for SFX, and MOSS‑TTS‑Nano for CPU‑first realtime deployment (~0.1B parameters).
  • Torch‑free and edge paths: documented torch‑free inference using llama.cpp + GGUF backbones and ONNX audio tokenizers enables deployment without PyTorch, while companion repos provide runnable llama.cpp pipelines and quantized weights for lighter deployments.
  • Deployment and ecosystem: official releases on Hugging Face and ModelScope, SGLang accelerated backend and guides for llama.cpp, plus tutorials for fine‑tuning and low‑memory configs (e.g., 8GB GPU modes).
  • Empirical emphasis: the project reports family‑level evaluations (Seed‑TTS‑eval, TTSD metrics) and technical reports on arXiv for core components, making it suitable for both applied engineering and reproducible research.
Who it’s for — and tradeoffs

Great fit if you need a modular, research‑friendly TTS stack that supports long‑form synthesis, zero‑shot voice cloning, multi‑speaker dialogue, or on‑device CPU inference. The family approach lowers integration cost when you want to mix voice‑design, TTS and sound effects in one pipeline. Look elsewhere if you want a tiny single binary with no model downloads or if you cannot accept the engineering complexity: some family members are large (8B) and require careful GPU/quantization management. Also note operational considerations (pinned PyTorch versions in some install profiles) — the torch‑free paths reduce but do not eliminate setup work.

Where it fits

Use MOSS‑TTS when you need reproducible, composable open‑source TTS with multiple deployment options (GPU, CPU/Nano, or llama.cpp edge paths). For very small footprint single‑file deployments, consider micro TTS projects; for managed cloud TTS APIs, a hosted commercial TTS may be simpler but less flexible.

Information

  • Websitegithub.com
  • AuthorsMOSI.AI, OpenMOSS Team
  • Published date2026/02/07

Categories

More Items

GitHub
AI Audio2025

Provides text-to-speech synthesis and one-shot voice cloning via compact ONNX models and a larger KittenTTS 2 speech model. Offers CPU-first inference (25–506 MB models), 47 built-in voices, multilingual output, expression tags, streaming, and a Python SDK.

Hugging Face
AI Audio2026

Generates directed, multi-character, long-form speech from text with natural-language directions and voice cloning. Built on a 35B MoE backbone (3B active per token) with a codebook multi-token-prediction decoder to enable multi-turn revision, infilling edits, streaming, and expressive control.

GitHub
AI Audio2025

Generates full songs from lyrics and style prompts by first writing an editable melody-and-chord score and then rendering vocals and accompaniment. Unifies symbolic planning and audio synthesis in one pipeline, enabling readable score inspection, zero‑shot covers, and agent-driven editing.