Gives AI agents persistent long-term memory: ingests documents in any format and continuously builds a self-hosted knowledge graph fusing vector embeddings, graph reasoning, and ontology grounding, so agents recall and reason over connected facts.
Cross-platform downloader that uses AI-assisted chunking and acceleration to improve success rates across protocols. Supports HTTP/FTP/M3U8/MPEG‑DASH/Magnet/BT plus YouTube/Bilibili parsing, a browser extension, aria2-compatible RPC and an Android client — aimed at multi-protocol, long-running and streaming download tasks.
Coordinates multiple LLM agents that converse to solve a task, splitting work across customizable roles that call tools, run code, and loop in humans. The v0.4 redesign adds async messaging and Python/.NET interoperability across distributed networks.
Detects file content types with a compact deep‑learning model that runs in milliseconds on a single CPU. Trained on ~100M samples across 200+ content types; offered as a Rust CLI plus Python, JS, and Go bindings for large‑scale security and file‑routing use.
Role-playing LLM agents — CEO, CTO, programmer, tester — collaborate through staged dialogues to turn a one-line prompt into a working software project. Now generalized into a zero-code platform for building custom multi-agent workflows beyond coding.
Converts microphone or streamed audio to text with sub-second latency, pairing WebRTC/Silero voice-activity detection and wake-word activation with swappable local backends — faster-whisper by default, plus whisper.cpp, Moonshine, and sherpa-onnx.
Converts videos between languages by transcribing audio, translating subtitles, and producing AI dubbing—supports local and online ASR/LLM/TTS providers, speaker diarization, voice cloning, and GUI/CLI workflows for batch or headless use.
Generates expressive multilingual speech from text, with sub-word control over prosody and emotion via inline tags like [whisper] or [angry]. Handles multi-speaker, multi-turn dialogue; the weights ship under a research-only license.
Provides a scalable physics-and-rendering simulation interface for robotics and embodied-AI research — unified multi-physics solvers, the Nyx renderer, and the Quadrants compiler. Runs from laptop to datacenter GPUs; suited for sensor-rich data generation and RL/robotics prototyping.
Performs speaker diarization (who spoke when) with pyannote-audio: combines voice-activity detection, speaker-change and overlapped-speech detection to produce time-stamped speaker segments; compatible with Hugging Face Endpoints and ASR pipelines.
Hands-free voice-first companion with a Live2D avatar for real-time conversations with LLMs. Cross-platform web and desktop clients, runs locally or via cloud APIs, supports local ASR/TTS and modular customization for personas and models.
Collection of runnable model implementations — LLaMA, Mistral, Stable Diffusion, Whisper, CLIP, plus LoRA fine-tuning — ported to the MLX array framework so they run natively on Apple silicon's unified memory rather than CUDA.