AI Infra2025
High-performance CUDA tensor-core GEMM kernel library for LLM workloads: supports FP8/FP4/BF16, fused Mega MoE and MQA scoring, and runtime JIT-compiled kernels. Targets NVIDIA SM90/SM100 and PyTorch—for teams working on low-level GPU kernel optimization.
AI Infra2025
Provides high-throughput, low-latency GPU communication kernels for Mixture-of-Experts (MoE) and expert-parallel workloads, with NVLink↔RDMA-aware forwarding, FP8/BF16 support, and low-latency RDMA hooks for inference decoding.
AI Train2025
An asynchronous, high-throughput framework for large-scale reinforcement learning and agentic training that scales to 1T+ MoE models and 1000+ GPUs, with native verifiers integration, end-to-end SFT/RL/evals, and Slurm/Kubernetes deployment; requires NVIDIA GPUs.
AI Coding2025
Performs fast static type checking and provides a language server with code navigation, semantic highlighting, and completions for Python. Processes ~1.85M lines/sec and completes IDE rechecks typically under 10ms — intended for responsive editor workflows and large codebases.
AI Infra2025
Optimized MLA (Multi-head Latent Attention) decoding kernels powering DeepSeek-V3/V3.2 inference on Hopper and Blackwell GPUs. Dense decoding reaches ~3000 GB/s and 660 TFLOPS on H800; the sparse path stores the KV cache in FP8.
AI Train2025
inclusionAI (AReaL Team), Institute for Interdisciplinary Information Sciences, Tsinghua University +1Ant Group, Institute for Interdisciplinary Information Sciences, Tsinghua University
Trains LLM reasoning and agentic models with fully asynchronous reinforcement learning, decoupling rollout generation from policy updates for a 2.77x speedup over synchronous RL. Covers GRPO, PPO and DAPO across Megatron, FSDP, vLLM and SGLang backends.
Embodied AI2025
A vision-language-action foundation model and reference stack for generalized humanoid and cross-embodiment robot manipulation. Provides pretrained checkpoints, demo datasets, and tooling for fine-tuning, evaluation, and deployment (ONNX/TensorRT); released as Early Access.
AI Train2025
Trains multi-step LLM agents with reinforcement learning (GRPO) on your own tasks, wrapping existing agent code behind an OpenAI-compatible client. Its RULER mode scores trajectories with an LLM judge, so there's no reward function to hand-write.
AI Image2025
Real-time DETR detector on a DINOv2 backbone, covering detection, segmentation, and keypoints. Ships in six sizes (Nano to 2XL), beats YOLO on the COCO speed-accuracy curve, and transfers better to non-COCO real-world domains.
AI Agent2025
Autonomously proposes hypotheses, runs experiments, analyzes results, and drafts workshop-level papers via an agentic tree-search pipeline. Unlike template-driven predecessors, it explores open-ended ML research paths but requires GPU/PyTorch and careful sandboxing due to execution of LLM-written code.
AI Audio2025
Open-source TTS that clones a voice from a short reference clip across 23+ languages, with adjustable emotional intensity via exaggeration/cfg controls and a built-in Perth neural watermark on every output.