AI Train2019
Trains transformer models from 2B to 462B parameters across thousands of GPUs by combining tensor, pipeline, context, and expert parallelism. Ships composable building blocks (Megatron Core) plus reference scripts, with FP8/FP4 and ~47% MFU on H100s.
AI Infra2020
An AI-native, weight-centric infrastructure for quantitative trading that produces target portfolio weight vectors to unify data ingestion, strategy composition, backtesting, and live/broker execution. Modular pipeline supports ML/DRL allocators, LLM-ready preprocessing, multi-source data, and Alpaca integration for paper/live trading.
AI Infra2020
Covers the full AI quant pipeline — point-in-time data, model training, backtesting, portfolio optimization, and order execution. Supports supervised learning, market dynamics, and RL on 20+ models, plus an LLM-based RD-Agent for factor mining.
AI Infra2020
Sits between PyTorch and micrograd: eager tensors with autograd plus a small, fully hackable compiler that fuses operations into kernels. Adding a new accelerator backend takes about 25 low-level ops, so it runs on CUDA, Metal, AMD, and WebGPU.
AI Train2021
HPC-AI Technology Inc. (Colossal-AI team), Shenggui Li +1HPC-AI Technology Inc., National University of Singapore
Scales a single-GPU training script to thousands of GPUs through a unified interface, combining data, pipeline, tensor, and sequence parallelism. Its Gemini memory manager offloads tensors across GPU, CPU, and NVMe so models far larger than VRAM still fit.
AI Deploy2022
Deploys PyTorch models directly on phones, microcontrollers, and embedded hardware via ahead-of-time compilation to a ~50KB C++ runtime. Delegates subgraphs to 12+ backends (XNNPACK, CoreML, Qualcomm, ARM Ethos-U) with torchao quantization.
AI Infra2022
Compiles plain Python functions into GPU or CPU kernels at runtime via a JIT decorator, with differentiable output that plugs into PyTorch, JAX, and Paddle. Ships physics, robotics, geometry, and FEM primitives — particles, meshes, ray-casting, FFT.
AI Image2022
Unifies successive YOLO generations — YOLOv8, YOLO11, YOLOv3 and newer — under one package and a single `YOLO` API spanning detection, segmentation, classification, pose, oriented boxes and tracking, plus one-line export to ONNX, TensorRT and CoreML.
AI Agent2022
Build, run, and monitor LLM agents across one stack: an open framework for chaining models and tools, LangGraph for stateful agent orchestration, and LangSmith for tracing, evaluation, and deployment in production.
AI Agent2022
Build LLM-powered agents and applications from modular components: provider-agnostic model abstractions, tool integrations, retrievers for RAG, and agent orchestration primitives. Suited for prototyping and production agent workflows; requires developer wiring and dependency management.
AI Infra2022
Build full‑stack web apps entirely in Python — write frontend components and backend state as Python classes with a reactive model. Provides fast refresh, deployment tooling, and AI-focused integrations such as an AI Builder and an Agent Toolkit for connecting LLMs and image models.
AI Infra2022
Unified Python framework where the same code runs on batch and streaming data, backed by a Rust engine on Differential Dataflow for incremental computation. Aimed at ETL, analytics, and live RAG pipelines over Kafka and 300+ connectors.