AI Infra2018
Rust-native, event-driven trading platform for backtesting and live execution across crypto, forex, equities, and futures on 27+ venues. The same strategy code runs in nanosecond backtests and in production, giving true research-to-live parity.
AI Model2018
Provides unified model definitions and a single API for pretrained text, vision, audio, and multimodal models for both training and inference. Emphasizes cross-framework compatibility (PyTorch/TF/JAX), pipeline-based inference, and direct access to 1M+ Hub checkpoints.
AI Infra2018
Turns NumPy-style Python into differentiable, compiled, vectorized programs for CPU, GPU, and TPU. Its leverage is composable transformations: grad, jit, vmap, and sharding combine instead of living in separate APIs.
AI Image2019
Bundles hundreds of pretrained image backbones — ResNet, EfficientNet, ViT, ConvNeXt, Swin and more — behind one consistent API for classification and feature extraction, with training and inference scripts that reproduce published ImageNet results.
AI Train2019
Turns raw PyTorch training loops into structured modules that scale from a laptop to multi-node GPUs without rewriting model logic. It handles precision, checkpointing, logging, and distributed execution while preserving PyTorch control.
AI Train2019
Implements deep RL algorithms (PPO, DQN, SAC, TD3, DDPG, C51, PPG) as standalone single-file scripts — the PPO Atari variant is ~340 readable lines. Built for research debugging and reproducibility, with W&B and TensorBoard tracking.
AI Audio2019
Build, fine-tune, and deploy speech AI on NVIDIA GPUs: ASR, text-to-speech, and speech LLMs in one PyTorch stack. Ships pretrained Parakeet/Canary recognition and Magpie TTS checkpoints; broader LLM/multimodal training now lives in v2.7.0.
AI Audio2019
Provides a toolkit and codebase for building, training, and deploying speech and multimodal models — Automatic Speech Recognition, Text-to-Speech, and speech-aware LLMs — with modular neural components and pre-trained checkpoints for PyTorch. Supports streaming/low-latency inference, multi-language models, and optional compiled kernels for acceleration.
AI Image2019
Modular implementations of object detection, instance/semantic/panoptic segmentation and related vision models for research and deployment. Offers a large model zoo, export to TorchScript/Caffe2, and PyTorch-native optimizations for faster training and extensibility.
AI Train2019
Trains transformer models from 2B to 462B parameters across thousands of GPUs by combining tensor, pipeline, context, and expert parallelism. Ships composable building blocks (Megatron Core) plus reference scripts, with FP8/FP4 and ~47% MFU on H100s.
AI Train2020
thu-ml (Tsinghua University Machine Learning Group)Tsinghua University, appliedAI Institute for Europe
Deep reinforcement learning library on pure PyTorch and Gymnasium, with 30+ algorithms across on-policy, off-policy, and offline RL. Exposes both a one-call high-level interface and a procedural API, plus vectorized envs and reproducible MuJoCo benchmarks.
AI Infra2020
Optimizes distributed PyTorch training and inference for very large models with ZeRO memory partitioning, parallelism, MoE, offload, and compression. Best when GPU memory, training cost, or cluster throughput is the bottleneck.