AI Infra2023
Lets you write compositional Python programs that compile into self‑improving LLM pipelines — replacing brittle prompt engineering with a declarative, programmatic approach and built‑in algorithms to optimize prompts and weights for RAG, multi‑stage pipelines, and agent loops.
AI Train2023
Modular PyTorch-based framework for building, training, and deploying physics-informed ML models (neural operators, PINNs, GNNs, diffusion). Provides GPU‑optimized training, domain-specific datapipes for meshes/point clouds, distributed scaling and a model zoo.
AI Agent2023
Maps your existing C#, Python, or Java functions into a form AI models can invoke, then translates model requests into real function calls and feeds results back. Model-agnostic middleware: swap in newer models without rewriting your app.
AI Agent2023
Framework for building multi-agent systems where LLM agents take roles and converse to complete tasks via inception prompting, with no human in the loop after the initial brief. Used to auto-generate instruction data and run large-scale agent simulations.
AI Train2023
Open platform for training, serving, and evaluating LLM chatbots; ships a distributed multi-model serving system with OpenAI-compatible APIs. Release home of Vicuna and Chatbot Arena, whose 1.5M+ human votes power an Elo leaderboard across 70+ models.
AI Train2023
Streamlines post-training and fine-tuning for large language and multimodal models with a single YAML-driven pipeline. Supports LoRA/QLoRA, full fine-tuning, preference tuning, RL methods, multi-GPU/FSDP/DeepSpeed, and many model backends (Hugging Face, local checkpoints).
AI Agent2023
Enterprise-grade multi-agent orchestration framework that builds, runs, and scales autonomous agent swarms for production. Offers modular swarm architectures, protocol support (MCP, AOP), a marketplace, multi-model provider integrations and observability.
AI Train2023
Fine-tunes 100+ LLMs and VLMs from one config file or a no-code web UI, unifying LoRA, QLoRA, full tuning, DPO, PPO, KTO and ORPO behind a single interface. Bundles GaLore, Unsloth, FlashAttention-2 and 2-8bit quantization to fit a single 24GB GPU.
AI Agent2023
Orchestrates LLM-based roles (product managers, architects, engineers) to turn a one-line requirement into user stories, APIs and a starter code repo. SOP-driven multi-agent workflows with CLI and library APIs for prototype generation and agentic development.
AI Train2023
Trains LLMs with RLHF at scale by splitting actor, critic, reward, and reference models across separate GPU groups via Ray, with vLLM-accelerated generation and DeepSpeed ZeRO-3. Supports PPO, GRPO, REINFORCE++, DPO, plus async and agentic multi-turn RL.
MLOps2023
Framework for unit-testing, evaluating and benchmarking LLM systems with ready-made metrics (G‑Eval, hallucination, task completion), support for local judge models and synthetic datasets, plus CI-friendly integrations for LangChain/OpenAI/Anthropic.
AI Agent2023
Agent framework for building tool-using applications on Qwen 3+ LLMs. Provides function calling, MCP, a Dockerized code interpreter, and RAG over documents up to 1M tokens; powers the Qwen Chat backend and a Chrome browser-assistant extension.