AI Deploy2021
Deploys trained SavedModels behind gRPC and REST endpoints, with hot-swappable versioning so new weights load without downtime. Built around servables, loaders, sources, and a manager, plus request batching to cut accelerator cost.
MLOps2021
Unified metadata platform for data discovery, observability, and governance — central metadata repository, column-level lineage, and a pluggable ingestion framework with 84+ connectors. Suited for teams that need searchable data catalogs, automated lineage, and collaborative data governance.
AI Infra2021
Runs, manages, and scales AI workloads across 20+ clouds, Kubernetes, Slurm, and on-prem from one YAML or Python spec. Auto-provisions GPUs/TPUs, fails over across regions and providers when capacity is short, and routes jobs to the cheapest option.
AI Deploy2021
Serves predictive and generative ML models on Kubernetes via a single InferenceService CRD, with scale-to-zero, canary rollouts, and an OpenAI-compatible LLM path on vLLM. One autoscaling abstraction over PyTorch, XGBoost, ONNX, and HuggingFace.
AI Train2021
HPC-AI Technology Inc. (Colossal-AI team), Shenggui Li +1HPC-AI Technology Inc., National University of Singapore
Scales a single-GPU training script to thousands of GPUs through a unified interface, combining data, pipeline, tensor, and sequence parallelism. Its Gemini memory manager offloads tensors across GPU, CPU, and NVMe so models far larger than VRAM still fit.
AI Image2021
Library for benchmarking, developing, and deploying deep-learning visual anomaly-detection models — includes ready-to-use model implementations (PatchCore, DINO-based), experiment/HPO tooling, OpenVINO export for edge inference, and a low-code Studio for deployment.
MLOps2021
Orchestrates ML training pipelines and production agent workflows from one Python codebase that runs unchanged from a laptop to Kubernetes or any cloud. Auto-versions artifacts, models, and agent checkpoints, with no orchestrator or framework lock-in.
AI Infra2022
Collects metrics, distributed traces, and continuous profiles via eBPF with zero code instrumentation, covering apps in any language plus gateways, service meshes, databases, and queues. Profiling adds under 1% overhead.
AI Image2022
Unifies successive YOLO generations — YOLOv8, YOLO11, YOLOv3 and newer — under one package and a single `YOLO` API spanning detection, segmentation, classification, pose, oriented boxes and tracking, plus one-line export to ONNX, TensorRT and CoreML.
AI Infra2022
Unified Python framework where the same code runs on batch and streaming data, backed by a Rust engine on Differential Dataflow for incremental computation. Aimed at ETL, analytics, and live RAG pipelines over Kafka and 300+ connectors.
MLOps2023
Centralizes logs, metrics, traces, frontend RUM and LLM observability into one self-hostable platform, using Parquet + S3-native storage and SQL/PromQL querying to reduce long‑term storage costs and unify telemetry analysis.
AI Infra2023
Aggregates alerts from dozens of monitoring tools into a single pane of glass, then deduplicates, correlates, and enriches them. Automates incident response with declarative YAML workflows — like GitHub Actions for your monitoring stack.