AIAny
AI Audio2026
Icon for item

MOSS-TTS Family

Generates high‑fidelity, expressive speech and environmental sounds from text. The MOSS‑TTS Family provides specialized models for long‑form TTS, multi‑speaker dialogue, voice design and realtime streaming, plus torch‑free inference paths (llama.cpp / ONNX) and Hugging Face releases.

Introduction

Production text‑to‑speech rarely comes from a single model: long stability, expressive dialogue, voice design, sound effects and low‑latency streaming impose different tradeoffs. The MOSS‑TTS Family intentionally splits those responsibilities across complementary models and a shared discrete audio interface so teams can compose pipelines for research or production without rebuilding every component.

What Sets It Apart
  • Unified discrete audio interface: the MOSS‑Audio‑Tokenizer (a causal RVQ‑based tokenizer) provides a single compressed audio representation for all family members, simplifying composition between voice design, TTS, dialogue and sound‑effect modules.
  • Multi‑model family design: each model targets a clear production niche — MossTTSDelay (8B) for long, stable zero‑shot cloning and throughput, MossTTSLocal (1.7B) for lightweight/streaming scenarios, MossTTSRealtime for low‑latency multi‑turn agents, MOSS‑VoiceGenerator for text‑only voice design, MOSS‑SoundEffect for SFX, and MOSS‑TTS‑Nano for CPU‑first realtime deployment (~0.1B parameters).
  • Torch‑free and edge paths: documented torch‑free inference using llama.cpp + GGUF backbones and ONNX audio tokenizers enables deployment without PyTorch, while companion repos provide runnable llama.cpp pipelines and quantized weights for lighter deployments.
  • Deployment and ecosystem: official releases on Hugging Face and ModelScope, SGLang accelerated backend and guides for llama.cpp, plus tutorials for fine‑tuning and low‑memory configs (e.g., 8GB GPU modes).
  • Empirical emphasis: the project reports family‑level evaluations (Seed‑TTS‑eval, TTSD metrics) and technical reports on arXiv for core components, making it suitable for both applied engineering and reproducible research.
Who it’s for — and tradeoffs

Great fit if you need a modular, research‑friendly TTS stack that supports long‑form synthesis, zero‑shot voice cloning, multi‑speaker dialogue, or on‑device CPU inference. The family approach lowers integration cost when you want to mix voice‑design, TTS and sound effects in one pipeline. Look elsewhere if you want a tiny single binary with no model downloads or if you cannot accept the engineering complexity: some family members are large (8B) and require careful GPU/quantization management. Also note operational considerations (pinned PyTorch versions in some install profiles) — the torch‑free paths reduce but do not eliminate setup work.

Where it fits

Use MOSS‑TTS when you need reproducible, composable open‑source TTS with multiple deployment options (GPU, CPU/Nano, or llama.cpp edge paths). For very small footprint single‑file deployments, consider micro TTS projects; for managed cloud TTS APIs, a hosted commercial TTS may be simpler but less flexible.

Information

  • Websitegithub.com
  • AuthorsMOSI.AI, OpenMOSS Team
  • Published date2026/02/07

Categories

More Items

Hugging Face
AI Audio2026

Generates low-latency, instruction-driven English and Chinese speech for voice cloning, voice design, and directed performances; supports real-time streaming, reference-free voice creation, and reference-guided cloning. Open-weight PyTorch model released under a research/non-commercial license with GPU recommendations.

Hugging Face
AI Audio2026

Zero-shot multilingual text-to-speech checkpoint for speech generation and voice cloning with a compact footprint. Features an ~170M-parameter main model plus a bundled ~120M-parameter codec decoder, with primary support for Chinese and English; other languages show more variable quality and long/noisy references reduce fidelity.

GitHub
AI Audio2026

Local-first voice workflows for cloning, multi-engine TTS/ASR, video dubbing, dictation, transcription and audiobook production across 646 languages. Desktop app with a local OpenAI-compatible API, engine catalogue (TTS/ASR/LLM), and explicit opt-ins for remote features to keep audio and projects on-device.