AI Image2023
Provides a diffusion-model studio for image, video, audio-video, editing, LoRA, and full training workflows so many model families share one inference and training framework.
AI Deploy2023
Builds custom AI inference servers in pure Python on top of FastAPI, keeping full control over request logic while batching, GPU autoscaling, streaming, and OpenAI-spec endpoints come built in. Claims a 2x+ throughput edge over plain FastAPI.
AI Model2023
Estimates and tracks 6D poses of novel objects without per-object fine-tuning — supports both model-based (CAD) and model-free (few reference images) setups. Trained on large-scale synthetic data with a transformer-based architecture and contrastive learning; CVPR 2024 highlight with demos and pretrained weights.
AI Infra2023
Provides a PyTorch-native platform for experimenting with and scaling generative AI training, including composable parallelism, checkpointing, float8, logging, and Llama recipes.
AI Infra2023
Triton kernels and PyTorch layers for linear-attention, state-space, and sparse-attention token mixers (GLA, RWKV, Mamba2, GSA) as drop-in replacements for multihead attention. Runs on NVIDIA, AMD, and Intel GPUs with Hugging Face support.
AI Infra2023
Traces how Transformer LLMs route information from input to output, attributing each block's effect to individual attention heads and feed-forward neurons. Click any edge to see what a head promotes or suppresses in vocabulary space.
AI Infra2024
Serves large language and multimodal models with low latency and high throughput using RadixAttention, continuous batching, structured outputs, parallelism, quantization, and broad accelerator support.
AI Model2024
Performs document OCR, layout analysis, reading-order detection and table recognition across 90+ languages using a ~650M-parameter vision–language model; offers per-page and per-block modes and supports GPU (vllm) and CPU/Apple Silicon backends.
AI Audio2024
Clones a voice from a 5-second sample for zero-shot TTS, or fine-tunes on ~1 minute of audio for few-shot synthesis. Covers Chinese, English, Japanese, Korean, and Cantonese, with a WebUI bundling vocal separation, ASR, and dataset labeling.
AI Image2024
Reworks AUTOMATIC1111's Stable Diffusion WebUI onto a custom backend that auto-manages GPU memory to speed inference and cut VRAM use. Adds native FLUX support with NF4/GGUF quantization and a UNetPatcher framework for model-agnostic extensions.
AI Audio2024
Converts e-books (epub, pdf, mobi, docx, and more) into chapter-aware audiobooks, with optional zero-shot voice cloning. Bundles eight TTS engines including XTTSv2 and Bark, and covers 1,158 languages via Meta's MMS — all runnable on CPU or GPU.
Embodied AI2024
A PyTorch-native, hardware-agnostic stack for robot learning: data collection, training, and deployment across 11+ robots, from SO100 to Unitree G1. Includes imitation, RL, and vision-language-action policies (ACT, Diffusion, Pi0, SmolVLA).