MLOps2023
Provides end-to-end observability, evaluation, and optimization for LLM-based applications by tracing model calls, running automated evaluations, and surfacing production metrics. Ships SDKs, broad framework integrations, LLM-as-a-judge metrics, and dashboards to support development, CI, and production monitoring.
AI Agent2023
Enterprise-grade multi-agent orchestration framework that builds, runs, and scales autonomous agent swarms for production. Offers modular swarm architectures, protocol support (MCP, AOP), a marketplace, multi-model provider integrations and observability.
AI Client2023
Synchronized desktop chat browser that opens multiple LLM webapps (ChatGPT, Claude, Bard, Bing, Llama2) and submits the same prompt to each for fast cross-provider comparison. Offers keyboard shortcuts, local-model hooks, and prompt-improvement utilities.
AI Infra2023
Tracks, evaluates, and debugs LLM applications with traces, prompt management, datasets, playgrounds, and observability that can run in cloud or self-hosted setups.
AI API2023
Unifies access to OpenAI, Anthropic, Google and other LLM providers behind one TypeScript API — swap models by changing a string. Adds streaming UI hooks for React, Next.js, Svelte and Vue, plus a tool-calling loop for agentic workflows.
AI Client2023
Browser-first, local-first note app that stores your notes as plain Markdown files and offers a chat-like input flow. LLM-friendly file structure, offline-capable PWA, and Telegram bot integration — data stays on your device unless you enable syncing.
AI Train2023
Fine-tunes 100+ LLMs and VLMs from one config file or a no-code web UI, unifying LoRA, QLoRA, full tuning, DPO, PPO, KTO and ORPO behind a single interface. Bundles GaLore, Unsloth, FlashAttention-2 and 2-8bit quantization to fit a single 24GB GPU.
AI Agent2023
Runs LLM-generated Python in a Rust sandbox that starts in tens of microseconds (~60µs), with no container overhead. Filesystem, network, and environment access are blocked, and state serializes for pause/resume with per-run resource limits.
AI API2023
Provides a RESTful integration layer that connects WhatsApp and other messaging services to external systems; supports both Baileys (Web) and WhatsApp Cloud API, multiple third-party integrations, media storage, and Docker deployment.
AI Infra2023
Runs 70B-class LLM inference on a single 4GB GPU without quantization and supports Llama3.1 405B on 8GB VRAM. Uses layer-splitting and block-wise model compression (4/8-bit) to reduce disk load and can speed up inference loading by up to ~3x; integrates with Hugging Face models.
AI API2023
Unified TypeScript toolkit for building AI apps and agents: swap between 100+ models from OpenAI, Anthropic, Google and others by changing one line. Ships streaming, tool calling, and framework-agnostic UI hooks for React, Next.js, Vue, and Svelte.
AI Client2023
Adds agent-native UI patterns to apps through chat, generative UI, shared state, human-in-the-loop flows, and AG-UI-based frontend integrations.