AI Audio2019
Provides a toolkit and codebase for building, training, and deploying speech and multimodal models — Automatic Speech Recognition, Text-to-Speech, and speech-aware LLMs — with modular neural components and pre-trained checkpoints for PyTorch. Supports streaming/low-latency inference, multi-language models, and optional compiled kernels for acceleration.
AI Train2019
Trains transformer models from 2B to 462B parameters across thousands of GPUs by combining tensor, pipeline, context, and expert parallelism. Ships composable building blocks (Megatron Core) plus reference scripts, with FP8/FP4 and ~47% MFU on H100s.
AI Infra2020
An AI-native, weight-centric infrastructure for quantitative trading that produces target portfolio weight vectors to unify data ingestion, strategy composition, backtesting, and live/broker execution. Modular pipeline supports ML/DRL allocators, LLM-ready preprocessing, multi-source data, and Alpaca integration for paper/live trading.
AI Infra2020
Provides vector search, LLM orchestration and language-model workflows with an embeddings database, RAG pipelines, multimodal indexing and agents. Runs locally or in containers and supports multiple models and language bindings (JS/Java/Rust/Go).
AI Infra2020
Covers the full AI quant pipeline — point-in-time data, model training, backtesting, portfolio optimization, and order execution. Supports supervised learning, market dynamics, and RL on 20+ models, plus an LLM-based RD-Agent for factor mining.
AI Infra2020
Sits between PyTorch and micrograd: eager tensors with autograd plus a small, fully hackable compiler that fuses operations into kernels. Adding a new accelerator backend takes about 25 low-level ops, so it runs on CUDA, Metal, AMD, and WebGPU.
AI Train2021
HPC-AI Technology Inc. (Colossal-AI team), Shenggui Li +1HPC-AI Technology Inc., National University of Singapore
Scales a single-GPU training script to thousands of GPUs through a unified interface, combining data, pipeline, tensor, and sequence parallelism. Its Gemini memory manager offloads tensors across GPU, CPU, and NVMe so models far larger than VRAM still fit.
AI Deploy2022
Deploys PyTorch models directly on phones, microcontrollers, and embedded hardware via ahead-of-time compilation to a ~50KB C++ runtime. Delegates subgraphs to 12+ backends (XNNPACK, CoreML, Qualcomm, ARM Ethos-U) with torchao quantization.
AI Infra2022
Compiles plain Python functions into GPU or CPU kernels at runtime via a JIT decorator, with differentiable output that plugs into PyTorch, JAX, and Paddle. Ships physics, robotics, geometry, and FEM primitives — particles, meshes, ray-casting, FFT.
AI Infra2022
Provides runtime support for reversible effects and reactive coeffects so components can be declared, composed, and hot-replaced safely; includes effect tracking, coeffect resolution, a declarative component loader and HMR — aimed at plugin-driven agent harnesses and dynamic systems.
AI Image2022
Unifies successive YOLO generations — YOLOv8, YOLO11, YOLOv3 and newer — under one package and a single `YOLO` API spanning detection, segmentation, classification, pose, oriented boxes and tracking, plus one-line export to ONNX, TensorRT and CoreML.
AI Agent2022
Build, run, and monitor LLM agents across one stack: an open framework for chaining models and tools, LangGraph for stateful agent orchestration, and LangSmith for tracing, evaluation, and deployment in production.