AI Infra2025
Spins up sandboxed VMs and containers (macOS, Linux, Windows, Android) that an AI agent can fully control through one unified SDK, cloud or local, plus a benchmark suite and background drivers that automate native apps without grabbing the cursor.
AI Train2025
inclusionAI (AReaL Team), Institute for Interdisciplinary Information Sciences, Tsinghua University +1Ant Group, Institute for Interdisciplinary Information Sciences, Tsinghua University
Trains LLM reasoning and agentic models with fully asynchronous reinforcement learning, decoupling rollout generation from policy updates for a 2.77x speedup over synchronous RL. Covers GRPO, PPO and DAPO across Megatron, FSDP, vLLM and SGLang backends.
AI Agent2025
Scaffolds production-ready GenAI agents on Google Cloud from one CLI command, wrapping your agent logic in Terraform, CI/CD, observability, and evaluation. Ships ADK, LangGraph, and multimodal RAG templates for Cloud Run or Vertex AI Agent Engine.
AI Infra2025
Keeps codebases, PDFs, Slack, and docs continuously indexed for RAG and knowledge graphs by recomputing only what changed, not the whole dataset. You declare target state in Python; a Rust engine maintains it with per-row lineage back to the source.
AI Infra2025
Runs and fine-tunes LLMs locally on Apple silicon via the MLX framework, pulling thousands of Hugging Face models with one command. Adds 4- and 8-bit quantization, LoRA and full fine-tuning, prompt caching, and distributed inference across Macs.
AI Deploy2025
Splits LLM inference into separate prefill and decode GPU pools, then routes requests with KV-cache awareness to cut redundant recomputation. Reports up to 30x throughput on DeepSeek-R1 (GB200 NVL72) and works across TensorRT-LLM, vLLM, and SGLang.
AI Infra2025
Federates MCP, A2A, and REST/gRPC backends behind a single gateway endpoint with centralized discovery, governance, and observability; optimizes agent and tool calling. Includes gRPC→MCP translation, plugin extensibility, OpenTelemetry tracing, and Kubernetes-ready deployment.
AI Agent2025
Transforms research papers, natural-language specs, and technical descriptions into runnable code via a multi-agent system. Covers Paper2Code, Text2Web, and Text2Backend; scores 75.9% on OpenAI's PaperBench, ahead of top ML PhDs.
AI Infra2025
Provides a community-curated database of AI model metadata—specs, pricing, and capabilities—and exposes it via a JSON API and a TOML-based contributor workflow for programmatic lookup and integration.
AI Infra2025
Provides a deterministic context and knowledge-graph layer under LLMs and vector stores to record auditable decisions, provenance, and explainable rule-based reasoning. Supports polyglot graph storage, W3C PROV-O export, SHACL governance, and self-hosted enterprise connectors.
Embodied AI2025
Provides a unified Python interface to collect data, train visual/dynamics world models, and evaluate them with model-predictive control across many standardized environments. Includes reference baselines, planning solvers, dataset converters, and LanceDB-backed formats for reproducible experiments. Best suited for researchers benchmarking world-model algorithms.
AI Infra2025
Model-compression toolkit for large LLMs/VLMs that integrates quantization (FP8/INT4/etc.), speculative decoding, token pruning and deployment hooks—designed for end-to-end performance on single/multi-GPU inference workflows and research-to-prod model optimization.