AI Dataset2026
End-to-end evaluation framework for conversational voice agents that runs bot-to-bot audio simulations and scores agents on task accuracy (EVA-A) and interaction experience (EVA-X). Includes per-scenario backend state, accent/noise perturbations, and 213 scenarios across airline, healthcare HR, and enterprise IT domains.
AI Model2026
Adds discrete audio tokens and an audio encoder to a 30B MoE text LLM so a single model can perform ASR, speech translation, TTS, text-to-audio and speech-to-speech while preserving text reasoning and long-context capabilities; supports thinking/instruct modes and up to 1M-token context.
AI Audio2026
Multilingual, low-latency text-to-speech model for speech generation and zero-shot voice cloning. Uses an MoE backbone with ECAPA-TDNN speaker embeddings, supports audio prefixes, fine-grained prosody/emotion controls and 44.1kHz output; optimized for Linux + NVIDIA GPUs.
AI Dataset2026
Provides kanji-level evaluation data for Japanese TTS: disambiguated sentence contexts targeting 4,378 kanji-reading pairs (2,136 Jōyō kanji) with 13,095 native-speaker–verified sentences and katakana-marked ground-truth readings for kanji-level error metrics.
AI Dataset2026
Provides over 1.1M hours of high-bandwidth, multichannel multilingual speech with segment- and word-level timestamps, English translations, and per-file metadata for ASR, TTS and audio-representation research. Preserves original 48kHz multichannel OPUS audio and is released under CC BY 3.0.
AI Audio2026
Generates streaming, low‑latency neural speech for real‑time dialogue by autoregressively producing audio frames as text arrives; joint text–speech training preserves natural prosody. Optimized for vLLM streaming (~50 ms first chunk), supports short‑clip voice cloning and four languages.
AI Audio2026
Generates English speech locally from text into 24 kHz waveforms with a fixed synthetic male voice. Complete text-to-waveform TTS under ~4M parameters (≈16 MB FP32), supports CPU/CUDA inference, deterministic seeds, long-text chunking and an ONNX export path under Apache-2.0 license.
AI Dataset2026
Provides ~1,467 single-speaker Sanskrit chant audio clips (≈5.3 hours) with aligned transcripts and prosodic metadata for meter-aware TTS training. Two recording/config styles (style_a/style_b), 24 kHz mono WAVs, metadata includes Devanagari, SLP1, Kannada text, meter, duration, session/take. CC-BY-4.0.
AI Audio2026
Multilingual neural text-to-speech model (0.6B params) with zero-shot voice cloning and a bundled 44.1 kHz codec. Preview release targets 11 recommended languages and aims to deliver near-SOTA quality in a compact checkpoint suited for voice cloning and multilingual TTS prototypes.
AI Audio2026
An end-to-end 11B full-duplex speech model for real-time conversational AI that jointly performs streaming speech understanding and generation, enabling ~450 ms turn-taking, barge‑in and live tool calling in a single unified architecture; research use only.
Generates multi‑speaker speech and environmental audio from textual instructions or a reference clip, supporting zero‑shot voice cloning and detailed scene/specification control. Combines a cleaned, captioned dataset with a VAE-based multimodal generator, reward-conditioned quality control, and staged training to improve expressiveness and multi-audio modeling.
AI Dataset2026
100-hour, single-narrator Egyptian Arabic speech corpus with 15,653 aligned clips at 24 kHz for TTS and ASR fine-tuning; studio-consistent audio, machine-generated undiacritized transcripts, CC BY-NC 4.0 (research/non-commercial use).