Tag

Gepard

Generates streaming, low‑latency neural speech for real‑time dialogue by autoregressively producing audio frames as text arrives; joint text–speech training preserves natural prosody. Optimized for vLLM streaming (~50 ms first chunk), supports short‑clip voice cloning and four languages.

Inflect-Nano-v2

Generates English speech locally from text into 24 kHz waveforms with a fixed synthetic male voice. Complete text-to-waveform TTS under ~4M parameters (≈16 MB FP32), supports CPU/CUDA inference, deterministic seeds, long-text chunking and an ONNX export path under Apache-2.0 license.

Vāgdhenu — Sanskrit Chant Corpus

Provides ~1,467 single-speaker Sanskrit chant audio clips (≈5.3 hours) with aligned transcripts and prosodic metadata for meter-aware TTS training. Two recording/config styles (style_a/style_b), 24 kHz mono WAVs, metadata includes Devanagari, SLP1, Kannada text, meter, duration, session/take. CC-BY-4.0.

Audio8 TTS Preview 0.6B

Multilingual neural text-to-speech model (0.6B params) with zero-shot voice cloning and a bundled 44.1 kHz codec. Preview release targets 11 recommended languages and aims to deliver near-SOTA quality in a compact checkpoint suited for voice cloning and multilingual TTS prototypes.

NVIDIA NemotronLabs VoiceChat 11B

An end-to-end 11B full-duplex speech model for real-time conversational AI that jointly performs streaming speech understanding and generation, enabling ~450 ms turn-taking, barge‑in and live tool calling in a single unified architecture; research use only.

SwanTale: Unified Multi-Speaker Speech and Audio Generation for Instruct and Zero-Shot Tasks

Generates multi‑speaker speech and environmental audio from textual instructions or a reference clip, supporting zero‑shot voice cloning and detailed scene/specification control. Combines a cleaned, captioned dataset with a VAE-based multimodal generator, reward-conditioned quality control, and staged training to improve expressiveness and multi-audio modeling.

Masri 100h — Egyptian Arabic Single-Speaker Speech Corpus

100-hour, single-narrator Egyptian Arabic speech corpus with 15,653 aligned clips at 24 kHz for TTS and ASR fine-tuning; studio-consistent audio, machine-generated undiacritized transcripts, CC BY-NC 4.0 (research/non-commercial use).

AuK: An Open-Source Foundational Model for Speech Generation and Editing

Generates and edits speech from natural-language instructions plus optional reference audio, supporting zero-shot TTS, content/acoustic/paralinguistic edits, enhancement, and source separation. Open-source 1.5B-parameter base model with a 4-step distilled AuK‑Flash for faster inference.

Audio8 TTS Preview 0.1B

Zero-shot multilingual text-to-speech checkpoint for speech generation and voice cloning with a compact footprint. Features an ~170M-parameter main model plus a bundled ~120M-parameter codec decoder, with primary support for Chinese and English; other languages show more variable quality and long/noisy references reduce fidelity.

Pipecat PhoneLLM Alpha 1

Open-weights LLM fine-tuned for phone-based voice agents that prioritizes low latency and reliable tool/function calling. Based on NVIDIA Nemotron 3 Nano (30B total, 3.5B active), supports very long contexts (262,144 tokens) and recommends temperature=0 with thinking disabled for deployment.

Breeze TTS 2

Generates low-latency, instruction-driven English and Chinese speech for voice cloning, voice design, and directed performances; supports real-time streaming, reference-free voice creation, and reference-guided cloning. Open-weight PyTorch model released under a research/non-commercial license with GPU recommendations.

Text-to-Speech Human Preferences (315K)

Provides 315,000 pairwise human-preference votes comparing 15 English TTS models over 300 operational prompts, with 4,500 high‑quality audio renders and structured vote/pair/prompt records for training or evaluating preference/reward models. Metadata under CC-BY-4.0; audio use governed by model providers' terms.