AI Image2019
Bundles hundreds of pretrained image backbones — ResNet, EfficientNet, ViT, ConvNeXt, Swin and more — behind one consistent API for classification and feature extraction, with training and inference scripts that reproduce published ImageNet results.
AI Train2019
Turns raw PyTorch training loops into structured modules that scale from a laptop to multi-node GPUs without rewriting model logic. It handles precision, checkpointing, logging, and distributed execution while preserving PyTorch control.
MLOps2019
Write ML, AI, and data science pipelines as plain Python, debug them locally, then deploy the same code to cloud compute and production orchestration unchanged. Handles dependency pinning, data versioning, and experiment tracking automatically per run.
MLOps2020
Orchestrates ML pipelines and agentic workflows authored in plain Python, no DSL required. Adds durable execution with automatic retries and crash recovery, infra-aware autoscaling, and caching so the same code runs locally and at production scale.
AI Infra2020
Optimizes distributed PyTorch training and inference for very large models with ZeRO memory partitioning, parallelism, MoE, offload, and compression. Best when GPU memory, training cost, or cluster throughput is the bottleneck.
AI Infra2020
Covers the full AI quant pipeline — point-in-time data, model training, backtesting, portfolio optimization, and order execution. Supports supervised learning, market dynamics, and RL on 20+ models, plus an LLM-based RD-Agent for factor mining.
MLOps2021
Unified metadata platform for data discovery, observability, and governance — central metadata repository, column-level lineage, and a pluggable ingestion framework with 84+ connectors. Suited for teams that need searchable data catalogs, automated lineage, and collaborative data governance.
AI Infra2021
Runs, manages, and scales AI workloads across 20+ clouds, Kubernetes, Slurm, and on-prem from one YAML or Python spec. Auto-provisions GPUs/TPUs, fails over across regions and providers when capacity is short, and routes jobs to the cheapest option.
AI Deploy2021
Serves predictive and generative ML models on Kubernetes via a single InferenceService CRD, with scale-to-zero, canary rollouts, and an OpenAI-compatible LLM path on vLLM. One autoscaling abstraction over PyTorch, XGBoost, ONNX, and HuggingFace.
AI Train2021
HPC-AI Technology Inc. (Colossal-AI team), Shenggui Li +1HPC-AI Technology Inc., National University of Singapore
Scales a single-GPU training script to thousands of GPUs through a unified interface, combining data, pipeline, tensor, and sequence parallelism. Its Gemini memory manager offloads tensors across GPU, CPU, and NVMe so models far larger than VRAM still fit.
MLOps2021
Orchestrates ML training pipelines and production agent workflows from one Python codebase that runs unchanged from a laptop to Kubernetes or any cloud. Auto-versions artifacts, models, and agent checkpoints, with no orchestrator or framework lock-in.
AI Infra2022
Collects metrics, distributed traces, and continuous profiles via eBPF with zero code instrumentation, covering apps in any language plus gateways, service meshes, databases, and queues. Profiling adds under 1% overhead.