Open-source TTS that clones a voice from a short reference clip across 23+ languages, with adjustable emotional intensity via exaggeration/cfg controls and a built-in Perth neural watermark on every output.
A toolkit and open-weights system for real-time streaming music generation — offers two model sizes (230M / 2.4B), a Python inference library (JAX/MLX), and a C++ engine optimized for Apple Silicon for embedding into DAWs and apps; real-time streaming requires M‑series chips.
Synthesizes up to 90 minutes of multi-speaker speech in one pass, with as many as four voices in a single conversation. Pairs continuous acoustic and semantic tokenizers at a 7.5 Hz frame rate with a next-token diffusion head on an LLM backbone.
Isolates any single sound from a complex audio mixture using a text description, a visual cue from a video frame, or a time span, returning both the isolated target and the residual. Released in small, base, and large sizes plus visual-prompt variants.
Generates and edits full-length music locally using a hybrid language-model planner and a diffusion transformer. Provides text- and audio-driven song synthesis plus selective editing (cover generation, repainting, vocal→BGM), metadata control and lightweight LoRA personalization, and runs on consumer GPUs/CPUs.
Build and self-host production voice agents with a drag-and-drop workflow builder, real-time telephony integration, and pluggable LLM/STT/TTS backends. Docker-first with an optional managed cloud offering for teams that want faster onboarding.
On-device macOS dictation that transcribes speech locally and offers an optional local AI enhancement (Fluid Intelligence) for smart formatting and post-processing. Key features: low-latency model choices, live transcription overlay, per-app prompts and privacy-by-default; best on Apple Silicon.
Runs text-to-speech with instant voice cloning fully on-device, from phones to GPUs. Built on small LLM backbones (120M-360M params) plus a 50Hz neural codec; clones a voice from ~3 seconds of audio across English, Spanish, German, and French.
Delivers multilingual, on-device text-to-speech via ONNX Runtime with prebuilt ONNX assets and cross-platform SDKs (Python, Node, mobile); targets low-latency, privacy-preserving TTS with ready demos and 31-language support in v3.
Real‑time full‑duplex speech‑to‑speech system that controls conversational role via text prompts and voice timbre via audio-conditioned embeddings. Built on Moshi; optimized for low-latency, persona-consistent spoken interactions.
Generates low-latency, streaming text-to-speech entirely on CPUs (no GPU or cloud API required), using an ~100M-parameter model with voice cloning and multilingual support. Optimized for low resource use (2 CPU cores, ~200ms to first audio chunk) — suited for local, privacy-sensitive, or embedded TTS.