AIAny
AI Audio2026
Icon for item

Fish Audio Drama 3

Generates directed, multi-character, long-form speech from text with natural-language directions and voice cloning. Built on a 35B MoE backbone (3B active per token) with a codebook multi-token-prediction decoder to enable multi-turn revision, infilling edits, streaming, and expressive control.

Introduction

Drama 3 focuses on one practical gap in speech generation: directing and iterating performances the way you direct actors. Rather than producing a single static TTS output, it treats speech generation as an interactive, editable production—supporting inline natural-language direction, multi-turn revisions, localized infilling edits, multi-character scenes, and chunked streaming for long recordings.

Key Capabilities
  • Directed multi-character scenes: embed speaker tags and plain-language directions to produce scenes with up to 16 distinct voices in a single request, preserving timbre and roles across long dialogues.
  • Editability and multi-turn revision: chain fixes and director notes so the model revises prior takes in context rather than re-generating from scratch, and perform localized infilling edits that keep surrounding acoustic transitions natural.
  • Architecture and decoding: a 35B-parameter mixture-of-experts text backbone (≈3B active per token) paired with a codebook multi-token-prediction audio decoder; this design enables finer acoustic detail, multi-codebook decoding, and long-context causal decoding over frames.
  • Production-ready streaming and throughput: engineered for low time-to-first-audio and high streaming throughput; supports deployment via SGLang-Omni and scales with vocoder placement to improve concurrent stream performance.
Who it's for and tradeoffs

Great fit if you produce scripted audio drama, podcasts, multi-character narration, or need iterative directed TTS workflows that require precise control over delivery and easy post-hoc edits. Look elsewhere if you need minimal-resource on-device inference (Drama 3 leverages a large MoE backbone and multi-GPU deployment patterns) or if you require an unrestricted commercial license—check the model license for usage constraints. The model improves expressiveness and editability at the cost of higher model size and deployment complexity compared with small single-GPU TTS systems.

More Items

GitHub
AI Audio2025

Generates full songs from lyrics and style prompts by first writing an editable melody-and-chord score and then rendering vocals and accompaniment. Unifies symbolic planning and audio synthesis in one pipeline, enabling readable score inspection, zero‑shot covers, and agent-driven editing.

Hugging Face
AI Audio2026

On-device speech-to-text for short clips (up to 30s) in seven languages, yielding transcripts, word-level timestamps and per-frame speech embeddings in a single 16.9 MB model. Runs on the Needle CPU engine with 2–4 bit quantization, supports keyword biasing and returns empty transcripts for silence.

Hugging Face
AI Audio2026

Transcribes English speech into punctuated, capitalized text — a 164 MB quantized ASR model that averages 5.21% WER across seven Open ASR Leaderboard sets. Optimized for on-device and CPU/GPU inference, with fast runtimes on Apple M5 and Docker/GPU support.