Provides leaderboard-ready test splits for the Open ASR Leaderboard: converts unsafe custom loaders to Parquet, sorts samples by audio length, and packages eight ESB test sets (LibriSpeech, Common Voice, GigaSpeech, SPGISpeech, etc.) for reproducible ASR benchmarking.
Open-source TTS that clones a voice from 3-10s of audio and synthesizes cross-lingual speech in 9 languages and 18+ Chinese dialects. Supports streaming at ~150ms latency with instruction control over emotion, speed, and accent.
Chains four swappable open modules — voice activity detection, speech-to-text, an LLM, and text-to-speech — into a local voice agent that needs no proprietary APIs. Runs on CUDA, Apple Silicon, or Docker, with an OpenAI-compatible realtime WebSocket mode.
Runs local LLM, vision-language, ASR, OCR, and image-generation models across NPU, GPU, and CPU from one command. Differs from Ollama and llama.cpp with first-class Qualcomm Hexagon NPU support and day-0 coverage of new models like Qwen3-VL.
VideoCaptioner is an AI-powered video subtitling assistant that combines ASR (local or cloud) with LLM-based subtitle segmentation, correction and translation. It supports offline GPU transcription, concurrent chunk transcription, VAD, speaker-aware processing, batch subtitling and one-click subtitle-to-video synthesis, with both GUI and CLI options.
Runs text-to-speech, speech-to-text, and speech-to-speech models natively on Apple Silicon via MLX — no CUDA or cloud. Supports 20+ TTS and 15+ STT models (Kokoro, Whisper, Qwen3), low-bit quantization, an OpenAI-compatible API, and a Swift package.
A self-hostable virtual companion: a VRM or Live2D character you own that voice-chats in real time, plays Minecraft and Factorio, and runs models in-browser via WebGPU or across 25+ LLM providers like Ollama, OpenAI, and Claude.
Provides an open platform of omnimodal world models, datasets, and tools to build Physical AI — joint perception, generation, and action reasoning for robots, autonomous vehicles, and smart infrastructure. Supports images, video, audio, and action-conditioned workflows.
Connects to Gmail, Calendar, and meeting notes to build a local, Obsidian-compatible Markdown graph it acts on — drafting emails, briefs, and decks. Memory accumulates instead of resetting each session; runs on local or hosted models, extensible via MCP.
Press a configurable shortcut, speak, and have your words transcribed and pasted into the active app. Runs Whisper or the CPU-friendly Parakeet V3 fully offline; a Tauri + Rust build with Silero voice-activity detection and optional GPU acceleration.
Provides real-time, local audio recording and transcription on macOS using Whisper and Parakeet engines, with global hotkeys and hold-to-record behavior. Includes model download, microphone selection, drag-and-drop file transcription, multilingual auto-detection and Asian-language autocorrect; Apple Silicon only.