Enables bidirectional checkpoint conversion between Hugging Face and Megatron formats and provides a PyTorch-native training library with tensor/pipeline parallelism, FP8/BF16 mixed precision, SFT and PEFT (LoRA) support for large and multimodal models.
Physics-aware simulated sensor dataset for training and evaluating autonomous-vehicle perception and control models. Includes multimodal sensor streams with physical-scene annotations intended for tasks that require grounding in real-world dynamics.
1,000,000 US-focused synthetic persona records (6M persona texts) grounded to demographic, geographic and personality distributions. Contains age, sex, education, occupation and ZCTA/city fields; CC BY 4.0 license for LLM training, diversity augmentation, and bias mitigation.
Generates explorable, 3D-consistent virtual worlds from a single image or short video. Includes official implementations of Lyra‑1 (feed‑forward 3D/4D scene generation via video-diffusion self-distillation) and Lyra‑2 (long-horizon, explorable generative 3D worlds). Best for research and creative prototyping; requires substantial GPU compute.
Provides an NVFP4‑optimized training and inference infrastructure for long-form video diffusion models — supports multi-shot AR training, KV-cache and NVFP4 quantized inference, sequence-parallelism and async decoding for higher FPS and longer outputs.
Generates production-grade synthetic datasets from scratch or from seed data using dependency-aware samplers, LLM-backed text columns, built-in validators, previewing, and LLM-as-judge scoring.
Contains training, evaluation, and deployment code plus checkpoints for humanoid whole-body controllers (Decoupled WBC and GEAR‑SONIC). Includes C++ inference, VR teleoperation, data pipelines (Bones‑SEED) and Hugging Face checkpoints for research-to-robot workflows.
Converts images (and other conditions) into high-fidelity, fully textured 3D assets using a 4B-parameter generative model and a field‑free sparse voxel format (O‑Voxel). Handles arbitrary topology, PBR materials, and near real-time mesh/voxel conversions; requires Linux and an NVIDIA GPU with >=24GB memory.
Real‑time full‑duplex speech‑to‑speech system that controls conversational role via text prompts and voice timbre via audio-conditioned embeddings. Built on Moshi; optimized for low-latency, persona-consistent spoken interactions.
Large-scale mathematical reasoning dataset of model-generated solution trajectories produced with and without Python Tool-Integrated Reasoning (TIR), with final answers verified against reference solutions. Contains ~3.64M JSONL training samples (~144 GB) and per-source CC-BY / CC-BY-SA licensing; intended for training and evaluating tool-augmented mathematical reasoning in LLMs.
A transparent proxy that lets Claude Code CLI and the VSCode extension run without an Anthropic API key by routing requests to NVIDIA NIM, OpenRouter, LM Studio, or llama.cpp; supports per-model mapping, thinking-token parsing, and messaging integration.
Generates anime-style and other non-photorealistic illustrations from text prompts. A 2B-parameter diffusion base preview trained on millions of anime images (and ~800k non-anime art) and released under a non-commercial license; best used in ComfyUI around ~1MP resolution.