AI Infra2021
Drop-in transformer building blocks with custom CUDA kernels: memory-efficient exact attention (up to ~10x faster), block-sparse attention, fused softmax/layernorm/SwiGLU ops. Cuts VRAM and speeds up diffusion and LLM training on Nvidia GPUs.
AI Train2021
HPC-AI Technology Inc. (Colossal-AI team), Shenggui Li +1HPC-AI Technology Inc., National University of Singapore
Scales a single-GPU training script to thousands of GPUs through a unified interface, combining data, pipeline, tensor, and sequence parallelism. Its Gemini memory manager offloads tensors across GPU, CPU, and NVMe so models far larger than VRAM still fit.
AI Image2021
Library for benchmarking, developing, and deploying deep-learning visual anomaly-detection models — includes ready-to-use model implementations (PatchCore, DINO-based), experiment/HPO tooling, OpenVINO export for edge inference, and a low-code Studio for deployment.
AI Audio2022
edge-tts is a Python module that enables the use of Microsoft Edge's online text-to-speech service directly from Python code or via command-line tools like edge-tts and edge-playback, without requiring Microsoft Edge, Windows, or an API key.
AI Infra2022
Fused CUDA kernels that compute exact attention without ever writing the full N×N score matrix to GPU memory, cutting memory from quadratic to linear and speeding up training and inference on A100/H100. Ships FlashAttention-2/3 plus KV-cache decode paths.
AI Model2022
Transformer-based foundation model for tabular data that provides pre-trained checkpoints for fast classification and regression, with GPU-accelerated local inference and an optional cloud client. Best suited for small-to-medium datasets (~≤50k rows).
AI Agent2022
Build LLM-powered agents and applications from modular components: provider-agnostic model abstractions, tool integrations, retrievers for RAG, and agent orchestration primitives. Suited for prototyping and production agent workflows; requires developer wiring and dependency management.
Embodied AI2022
GPU-accelerated robot-learning framework on NVIDIA Isaac Sim, running thousands of parallel environments on one GPU for reinforcement and imitation learning. Ships 30+ ready-to-train tasks and 16+ robot models wired to RSL RL, SKRL, and RL Games.
AI Audio2022
Alibaba DAMO Academy, Northwestern Polytechnical University (NWPU) +5Alibaba DAMO Academy, ModelScope
Bundles ASR, voice activity detection, punctuation, and speaker diarization into one pipeline, with pretrained models like Paraformer and SenseVoice. SenseVoice runs ~17x realtime on CPU; also ships streaming ASR and an OpenAI-compatible API.
AI Infra2022
Unified Python framework where the same code runs on batch and streaming data, backed by a Rust engine on Differential Dataflow for incremental computation. Aimed at ETL, analytics, and live RAG pipelines over Kafka and 300+ connectors.
AI Image2022
Provides reusable computer-vision utilities for dataset loading/conversion, visualization/annotation of detections and segmentation, and connectors to popular detection frameworks—aimed at quick prototyping, dataset work, and visualization.
AI Train2022
Reproduces GPT-2 (124M) from scratch on OpenWebText in ~4 days on an 8xA100 node, with the whole stack kept to two ~300-line files: train.py for the loop and model.py for the architecture. A char-level Shakespeare run finishes in ~3 minutes on one GPU.