Turns OpenAI Whisper into a live streaming transcriber: audio flows in over WebSocket and text returns word-by-word instead of after full utterances. Adds SimulStreaming and LocalAgreement decoding, Silero VAD, and speaker diarization, all self-hosted.
Provides a 10,000-hour Sichuanese (Chuan-Yu) speech corpus with rich annotations (timestamps, speaker age/gender/emotion, SNR, DNSMOS) and unified metadata for ASR and TTS research; includes metadata.jsonl, evaluation benchmarks, and an LLM-assisted transcription pipeline.
Real‑time full‑duplex speech‑to‑speech system that controls conversational role via text prompts and voice timbre via audio-conditioned embeddings. Built on Moshi; optimized for low-latency, persona-consistent spoken interactions.
Provides open ASR and TTS speech data for 24 Sub‑Saharan African languages to train and evaluate speech models. Includes ~1,250 hours of transcribed ASR and ~235 hours of single‑speaker TTS with train/validation/test/unlabeled splits and mixed CC-BY licenses.
Provides a unified plugin suite that connects OpenClaw AI assistants to Chinese IM platforms (WeChat, WeCom, QQ, DingTalk, Feishu). Focuses on stable messaging, unified plugin API, streaming replies, media handling and configurable delivery modes.
Turns natural-language directions into end-to-end video editing workflows: LLM-powered planning, media search/organization, ASR rough-cut, and reusable Style Skills for consistent storytelling. Integrates agent Skills (OpenClaw/Claude Code) and optional AIGC transitions.
Provides multi-task long-speech evaluation data for eight speech-understanding tasks (ASR, summarization, QA, translation, emotion, speaker counting, content separation, language detection). Includes 101,822 long audio files and ~204,881 annotated examples with JSONL task splits for easy loading.
Turns any topic or document into an interactive, multi-agent classroom that generates slides, quizzes, interactive simulations and project-based learning activities. Includes real-time AI teachers/classmates, whiteboard drawing, TTS/ASR, PPTX/HTML export and chat-app integration via OpenClaw.
Provides a unified 615k-hour English speech corpus for TTS training, aggregating 11 public datasets and web-sourced recordings into 16 kHz Opus WebDataset shards. Includes a quality-filtered core subset (510.1k hours), metadata splits, and mixed licenses across sources.
Provides 3,000+ hours (≈611K utterances) of transcribed 16 kHz multi-dialect Arabic speech across 13 dialects for ASR and spoken-dialect identification. Transcripts preserve dialectal orthography (partial diacritics); the train split is ~337 GB in parquet, so streaming is recommended.
Local-first voice workflows for cloning, multi-engine TTS/ASR, video dubbing, dictation, transcription and audiobook production across 646 languages. Desktop app with a local OpenAI-compatible API, engine catalogue (TTS/ASR/LLM), and explicit opt-ins for remote features to keep audio and projects on-device.