Implements deep RL algorithms (PPO, DQN, SAC, TD3, DDPG, C51, PPG) as standalone single-file scripts — the PPO Atari variant is ~340 readable lines. Built for research debugging and reproducibility, with W&B and TensorBoard tracking.
Modular implementations of object detection, instance/semantic/panoptic segmentation and related vision models for research and deployment. Offers a large model zoo, export to TorchScript/Caffe2, and PyTorch-native optimizations for faster training and extensibility.
Deep reinforcement learning library on pure PyTorch and Gymnasium, with 30+ algorithms across on-policy, off-policy, and offline RL. Exposes both a one-call high-level interface and a procedural API, plus vectorized envs and reproducible MuJoCo benchmarks.
Optimizes distributed PyTorch training and inference for very large models with ZeRO memory partitioning, parallelism, MoE, offload, and compression. Best when GPU memory, training cost, or cluster throughput is the bottleneck.
Covers the full AI quant pipeline — point-in-time data, model training, backtesting, portfolio optimization, and order execution. Supports supervised learning, market dynamics, and RL on 20+ models, plus an LLM-based RD-Agent for factor mining.
Collects 60+ PyTorch implementations of neural network papers — transformers, diffusion, GANs, RL, optimizers — each annotated line-by-line and rendered beside the code at nn.labml.ai, so you study the math and a runnable implementation together.
Unified framework for few-shot evaluation of generative language models across 60+ academic benchmarks. Supports multiple model backends (Hugging Face, vLLM, APIs, local servers), configurable prompts/YAML configs, and reproducible exports for leaderboards and research comparisons.
PyTorch library for operator learning: neural networks that map between whole function spaces, not fixed grids, so a model trained at one resolution runs at any other. Bundles FNO, Tensorized FNO and related architectures, mainly for solving PDEs.
Sits between PyTorch and micrograd: eager tensors with autograd plus a small, fully hackable compiler that fuses operations into kernels. Adding a new accelerator backend takes about 25 low-level ops, so it runs on CUDA, Metal, AMD, and WebGPU.
Typed Python client for the OpenAI REST API that offers synchronous and asynchronous clients, typed request/response models, streaming and Realtime support, webhook verification, and integrations for Azure and Amazon Bedrock—built for production integrations and automation.
Deploys trained SavedModels behind gRPC and REST endpoints, with hot-swappable versioning so new weights load without downtime. Built around servables, loaders, sources, and a manager, plus request batching to cut accelerator cost.