AI Audio2026
Generates music, sound effects, and general audio from text prompts using a medium-size Stable Audio 3 diffusion model — a balance of generation quality and inference cost suitable for prototyping, demo assets, and creative sound design workflows.
AI Dataset2026
Provides a large-scale ASR corpus organized by normalized acoustic subsets for robustness training and evaluation. About 645,925 examples across 54 acoustic conditions (noise, echo, far-field, recording distortions) with many distortion/dropout/noise Parquet splits. Distributed as split Parquet files; license not specified on the dataset page.
AI Model2026
Generates conversational speech and voice continuation from text and optional audio context, outputting Mimi audio codes. Built on a Sesame-style CSM with an 8B Llama-like backbone plus a smaller autoregressive audio decoder. Suited for local TTS inference and voice-cloning workflows.
AI Dataset2026
Large streaming-audio dataset for training and evaluating audio-LLMs and audio agents. About 2.28M clips grouped into multi-turn “streams” across six task subsets (ASR, speech translation, audio understanding, voice chat, proactive response, environment-aware); audio shipped as tar shards.
AI Audio2026
Generates multilingual text-to-speech with zero-shot voice cloning, token-level duration control, and inline pause markers. v1.5 improves multilingual fidelity (with language tags), cloning stability, and long-reference handling—suitable for research and production TTS pipelines.
AI Dataset2026
Provides ~100 hours of expert-annotated, multi-channel Chinese conversational speech with per-segment timestamps, speaker IDs and paralinguistic labels for turn-taking, overlap/interruption detection and full‑duplex dialogue research. Licensed for academic/non-commercial use (CC BY‑NC 4.0).
Zero-shot TTS for expressive long-form monologue and multi-speaker dialogue, designed to preserve acoustic consistency, conversational coherence, and affective continuity. Trained on SwanData-Speech and using a 25 Hz VAE, pause-aware text conditioning, and a flow-matching DiT with DiffusionNFT fine-tuning.
AI Audio2026
Converts text into expressive conversational speech across 100+ languages with zero-shot voice cloning and inline control tokens for emotion, style, prosody, pauses, and sound effects. Released under a research/non-commercial license; commercial use requires separate licensing.
AI Dataset2026
End-to-end evaluation framework for conversational voice agents that runs bot-to-bot audio simulations and scores agents on task accuracy (EVA-A) and interaction experience (EVA-X). Includes per-scenario backend state, accent/noise perturbations, and 213 scenarios across airline, healthcare HR, and enterprise IT domains.
AI Audio2026
Multilingual, low-latency text-to-speech model for speech generation and zero-shot voice cloning. Uses an MoE backbone with ECAPA-TDNN speaker embeddings, supports audio prefixes, fine-grained prosody/emotion controls and 44.1kHz output; optimized for Linux + NVIDIA GPUs.
AI Audio2026
Transcribes Arabic speech to text using a CohereLabs-trained ASR model compatible with the Hugging Face Transformers pipeline. Provides safetensors weights, endpoint compatibility and a DOI-tagged release; suitable for Arabic transcription workflows but may require adaptation for diverse dialects or noisy audio.
AI Audio2026
Generates streaming, low‑latency neural speech for real‑time dialogue by autoregressively producing audio frames as text arrives; joint text–speech training preserves natural prosody. Optimized for vLLM streaming (~50 ms first chunk), supports short‑clip voice cloning and four languages.