AI Agent2024
Orchestrates low-code multi-agent teams that plan, research, code and deliver results to Telegram, Discord, and WhatsApp. Includes handoffs, guardrails, memory and RAG, and integrates 100+ LLM providers via MCP for production-ready agent workflows.
AI Train2024
End-to-end framework for running and reproducing foundation-model research workflows — from data curation and tokenization to training and evaluation. Emphasizes reproducibility by recording every step (including failed runs) and expressing experiments as dependency-ordered steps.
AI Train2024
Accelerates video generation with a unified framework for inference, finetuning, LoRA, distillation, sparse attention, and distributed execution for research and demos.
AI API2024
Build AI workflows once and run them across model providers — GoogleAI, OpenAI, Claude, Ollama — through one SDK. Composable primitives for RAG, tool use, and agents, plus a local dev UI for tracing and debugging, with SDKs in JS/TS, Go, and Python.
AI Agent2024
Builds real-time multimodal conversational AI agents with voice-assistant examples, VAD, turn detection, RTC/WebSocket transport, avatars, transcription, and edge-device demos.
AI Agent2024
Provides a Python framework for building generative-AI agents and workflows with Pydantic-style type safety and composable capabilities. Model-agnostic provider support, built-in observability, human-in-the-loop tool approval, and durable execution for production use cases.
AI Infra2024
Connects multiple Macs and Linux machines into one cluster to run models too large for any single machine. Auto-discovers peers, shards a model across them via tensor parallelism, and exposes OpenAI-, Claude-, and Ollama-compatible APIs.
AI Agent2024
Local-first runtime for autonomous AI agents that run on-device and stay model-agnostic across OpenAI, Anthropic, Gemini, Grok, and local models. A plugin system adds chat platforms (Discord, Telegram, X), voice, browser automation, RAG, and wallets.
AI Agent2024
Connects LLM agents to 1,000+ apps (Gmail, Slack, GitHub, Notion, Stripe) with managed OAuth, just-in-time tool selection by intent, and sandboxed Python 3.11 execution. Agents authenticate and act on a user's behalf without bespoke integration code.
AI Infra2024
Official inference framework for 1-bit and ternary (1.58-bit) LLMs such as BitNet b1.58, with optimized CPU kernels. Delivers 1.37x-6.17x speedups and 55-82% lower energy on x86 and ARM, and runs a 100B model on a single CPU at 5-7 tokens/sec.
AI Infra2024
Runs local LLM, vision-language, ASR, OCR, and image-generation models across NPU, GPU, and CPU from one command. Differs from Ollama and llama.cpp with first-class Qualcomm Hexagon NPU support and day-0 coverage of new models like Qwen3-VL.
AI Deploy2024
Runs and optimizes ML and generative-AI models on-device across mobile, desktop, web, and IoT. Successor to TensorFlow Lite, it adds automated GPU/NPU accelerator selection and zero-copy buffer interop to cut latency without cloud round-trips.