AI Deploy2025
Turns OpenAI Whisper into a live streaming transcriber: audio flows in over WebSocket and text returns word-by-word instead of after full utterances. Adds SimulStreaming and LocalAgreement decoding, Silero VAD, and speaker diarization, all self-hosted.
AI Audio2025
Synthesizes up to 90 minutes of multi-speaker speech in one pass, with as many as four voices in a single conversation. Pairs continuous acoustic and semantic tokenizers at a 7.5 Hz frame rate with a next-token diffusion head on an LLM backbone.
AI Audio2025
Isolates any single sound from a complex audio mixture using a text description, a visual cue from a video frame, or a time span, returning both the isolated target and the residual. Released in small, base, and large sizes plus visual-prompt variants.
AI Audio2025
Generates and edits full-length music locally using a hybrid language-model planner and a diffusion transformer. Provides text- and audio-driven song synthesis plus selective editing (cover generation, repainting, vocal→BGM), metadata control and lightweight LoRA personalization, and runs on consumer GPUs/CPUs.
AI Dataset2025
Yuhang Dai, Ziyu Zhang +14Audio, Speech and Language Processing Group (ASLP@NPU), Northwestern Polytechnical University, Beijing AISHELL Technology Co., Ltd. +3
Provides a 10,000-hour Sichuanese (Chuan-Yu) speech corpus with rich annotations (timestamps, speaker age/gender/emotion, SNR, DNSMOS) and unified metadata for ASR and TTS research; includes metadata.jsonl, evaluation benchmarks, and an LLM-assisted transcription pipeline.
AI Audio2025
Build and self-host production voice agents with a drag-and-drop workflow builder, real-time telephony integration, and pluggable LLM/STT/TTS backends. Docker-first with an optional managed cloud offering for teams that want faster onboarding.
AI Audio2025
On-device macOS dictation that transcribes speech locally and offers an optional local AI enhancement (Fluid Intelligence) for smart formatting and post-processing. Key features: low-latency model choices, live transcription overlay, per-app prompts and privacy-by-default; best on Apple Silicon.
AI Audio2025
Runs text-to-speech with instant voice cloning fully on-device, from phones to GPUs. Built on small LLM backbones (120M-360M params) plus a 50Hz neural codec; clones a voice from ~3 seconds of audio across English, Spanish, German, and French.
AI Audio2025
Delivers multilingual, on-device text-to-speech via ONNX Runtime with prebuilt ONNX assets and cross-platform SDKs (Python, Node, mobile); targets low-latency, privacy-preserving TTS with ready demos and 31-language support in v3.
AI Client2025
Generates summaries from URLs, YouTube videos, podcasts, PDFs, and local audio or video files. Backend-agnostic by design: the same pipeline drives local coding CLIs (Claude, Codex, Gemini) or hosted API providers (OpenAI, Google, xAI).
AI Audio2026
Real‑time full‑duplex speech‑to‑speech system that controls conversational role via text prompts and voice timbre via audio-conditioned embeddings. Built on Moshi; optimized for low-latency, persona-consistent spoken interactions.