Local-first runtime for autonomous AI agents that run on-device and stay model-agnostic across OpenAI, Anthropic, Gemini, Grok, and local models. A plugin system adds chat platforms (Discord, Telegram, X), voice, browser automation, RAG, and wallets.
Connects LLM agents to 1,000+ apps (Gmail, Slack, GitHub, Notion, Stripe) with managed OAuth, just-in-time tool selection by intent, and sandboxed Python 3.11 execution. Agents authenticate and act on a user's behalf without bespoke integration code.
Official inference framework for 1-bit and ternary (1.58-bit) LLMs such as BitNet b1.58, with optimized CPU kernels. Delivers 1.37x-6.17x speedups and 55-82% lower energy on x86 and ARM, and runs a 100B model on a single CPU at 5-7 tokens/sec.
Runs local LLM, vision-language, ASR, OCR, and image-generation models across NPU, GPU, and CPU from one command. Differs from Ollama and llama.cpp with first-class Qualcomm Hexagon NPU support and day-0 coverage of new models like Qwen3-VL.
Runs and optimizes ML and generative-AI models on-device across mobile, desktop, web, and IoT. Successor to TensorFlow Lite, it adds automated GPU/NPU accelerator selection and zero-copy buffer interop to cut latency without cloud round-trips.
GPU‑accelerated framework for training physically simulated humanoid characters and robots using reinforcement learning and motion imitation. Provides a modular multi‑backend simulator stack, large‑scale multi‑GPU training recipes, built‑in motion retargeting and an ONNX deployment pathway to real robots.
A compact domain-specific language for writing high-performance GPU/CPU kernels (GEMM, FlashAttention, sparse kernels) with Python-like syntax. It provides tiling/pipelining primitives, a TVM-based compiler and multiple backends (CUDA/CuTeDSL, NVRTC, WebGPU, Metal, Ascend) for operator-level performance work.
Framework for building and orchestrating multi-agent LLM systems, with agent types, tool integration, and human-in-the-loop workflows. Supports multi-agent conversation patterns, multiple LLM providers, and RAG-style tooling for research and prototyping agentic workflows.
Generates structured, streaming UIs from LLM output and renders them in React using a compact OpenUI Lang, built component libraries, and chat surfaces; claims up to ~67% token savings vs JSON and includes a playground and CLI.
Elixir-native autonomous agent framework that models state changes as pure cmd/2 operations and describes side effects with typed directives; integrates with OTP supervision and optional LLM plugins for AI-driven agents.
A 100-line LLM framework built on one graph abstraction of nodes and flows, with zero dependencies and no vendor wrappers. The tiny core composes agents, workflows, and RAG, and is small enough for a coding agent to read and extend on its own.
Provides an open platform of omnimodal world models, datasets, and tools to build Physical AI — joint perception, generation, and action reasoning for robots, autonomous vehicles, and smart infrastructure. Supports images, video, audio, and action-conditioned workflows.