AIAny
AI Audio2026
Icon for item

MOSS-TTS Family

Generates high‑fidelity, expressive speech and environmental sounds from text. The MOSS‑TTS Family provides specialized models for long‑form TTS, multi‑speaker dialogue, voice design and realtime streaming, plus torch‑free inference paths (llama.cpp / ONNX) and Hugging Face releases.

Introduction

Production text‑to‑speech rarely comes from a single model: long stability, expressive dialogue, voice design, sound effects and low‑latency streaming impose different tradeoffs. The MOSS‑TTS Family intentionally splits those responsibilities across complementary models and a shared discrete audio interface so teams can compose pipelines for research or production without rebuilding every component.

What Sets It Apart
  • Unified discrete audio interface: the MOSS‑Audio‑Tokenizer (a causal RVQ‑based tokenizer) provides a single compressed audio representation for all family members, simplifying composition between voice design, TTS, dialogue and sound‑effect modules.
  • Multi‑model family design: each model targets a clear production niche — MossTTSDelay (8B) for long, stable zero‑shot cloning and throughput, MossTTSLocal (1.7B) for lightweight/streaming scenarios, MossTTSRealtime for low‑latency multi‑turn agents, MOSS‑VoiceGenerator for text‑only voice design, MOSS‑SoundEffect for SFX, and MOSS‑TTS‑Nano for CPU‑first realtime deployment (~0.1B parameters).
  • Torch‑free and edge paths: documented torch‑free inference using llama.cpp + GGUF backbones and ONNX audio tokenizers enables deployment without PyTorch, while companion repos provide runnable llama.cpp pipelines and quantized weights for lighter deployments.
  • Deployment and ecosystem: official releases on Hugging Face and ModelScope, SGLang accelerated backend and guides for llama.cpp, plus tutorials for fine‑tuning and low‑memory configs (e.g., 8GB GPU modes).
  • Empirical emphasis: the project reports family‑level evaluations (Seed‑TTS‑eval, TTSD metrics) and technical reports on arXiv for core components, making it suitable for both applied engineering and reproducible research.
Who it’s for — and tradeoffs

Great fit if you need a modular, research‑friendly TTS stack that supports long‑form synthesis, zero‑shot voice cloning, multi‑speaker dialogue, or on‑device CPU inference. The family approach lowers integration cost when you want to mix voice‑design, TTS and sound effects in one pipeline. Look elsewhere if you want a tiny single binary with no model downloads or if you cannot accept the engineering complexity: some family members are large (8B) and require careful GPU/quantization management. Also note operational considerations (pinned PyTorch versions in some install profiles) — the torch‑free paths reduce but do not eliminate setup work.

Where it fits

Use MOSS‑TTS when you need reproducible, composable open‑source TTS with multiple deployment options (GPU, CPU/Nano, or llama.cpp edge paths). For very small footprint single‑file deployments, consider micro TTS projects; for managed cloud TTS APIs, a hosted commercial TTS may be simpler but less flexible.

Information

  • Websitegithub.com
  • AuthorsMOSI.AI, OpenMOSS Team
  • Published date2026/02/07

Categories

More Items

GitHub

Runs a self-hosted meeting bot and transcription API that joins Google Meet, Teams and Zoom and streams speaker-attributed transcripts in real time. Compiles meetings into a git-backed Markdown workspace and runs sandboxed agents on your infrastructure; Apache-2.0 and air-gap capable.

Hugging Face
AI Audio2026

Generates streaming, low‑latency neural speech for real‑time dialogue by autoregressively producing audio frames as text arrives; joint text–speech training preserves natural prosody. Optimized for vLLM streaming (~50 ms first chunk), supports short‑clip voice cloning and four languages.

Hugging Face
AI Audio2026

Transcribes Arabic speech to text using a CohereLabs-trained ASR model compatible with the Hugging Face Transformers pipeline. Provides safetensors weights, endpoint compatibility and a DOI-tagged release; suitable for Arabic transcription workflows but may require adaptation for diverse dialects or noisy audio.