Provides 2,170 reference-grounded evaluation samples across seven agent domains (MCP, Search, Terminal, SWE, Android, Web, OS) to score language world models on Format, Factuality, Consistency, Realism and Quality. Includes per-domain JSONL files, judge prompts and an evaluation script for reproducible scoring.
Provides ~2 million instruction-aligned video-edit pairs for training and evaluating instruction-based video editing and generation models. Covers multi-task and structural edits (e.g., camera/subject movement), produced via a synthesis pipeline with progressive filtering; licensed CC BY-NC-4.0.
Multimodal video dataset for text-to-video and video-to-video research: about 2 million short English videos and extracted frames for instruction-based video editing and generation. Hosted on Hugging Face and licensed CC BY‑NC 4.0 (non-commercial).
Compares 30 frontier LLMs generating static SVG markup from 500 prompts using 1,355,161 human votes across three leaderboards (Preference, Coherence, Alignment); provides raw SVGs, 768×768 rasterized PNGs, and per-comparison human vote records under a CC-BY-4.0 prompt license.
Measures how autonomous AI agents learn via long-horizon, feedback-rich executable tasks; publishes 51 public tasks from a 134-task suite and provides SForge, a two-container evaluation harness for iterative 12+ hour runs to track learning trajectories.
Measures whether models produce valid JSON/YAML that strictly follow a requested schema across diverse, naturally phrased prompts. Contains 2,000 frozen test prompts with binary structural validation (no constrained decoding), focusing on schema compliance and edge cases like escaping, wrapper keys, and fenced code blocks.
Provides 600,000+ first-person player-round videos (10,000+ hours) with per-frame keyboard, mouse-delta, and 3D trajectory annotations in WebDataset shards—built for training world models, action-conditioned video, and imitation-learning workflows (non-commercial license).
Provides ~1,467 single-speaker Sanskrit chant audio clips (≈5.3 hours) with aligned transcripts and prosodic metadata for meter-aware TTS training. Two recording/config styles (style_a/style_b), 24 kHz mono WAVs, metadata includes Devanagari, SLP1, Kannada text, meter, duration, session/take. CC-BY-4.0.
Provides runnable 3D programs with renders, descriptions, and metadata for training and evaluating models that generate 3D code from text or images. Dataset access is restricted to non-commercial research.
Provides SimReady 3D assets for robotics and industrial simulation. The OpenUSD content is prepared for simulation workflows, helping teams assemble environments for physical AI.
Provides 300 adversarial "metacognitive-trap" problems to measure whether LLMs notice and recover from their own reasoning errors. Combines multiple-choice vulnerability tests with free-form adapter-gain evaluation and ships per-model metacognition adapters for frozen-base probing.
Provides synchronized four-perspective Rocket League match recordings with per-frame H.264 video, player action streams, event logs, and privileged physics state — released as WebDataset shards in a ~4,000-hour slice (1,000 match-hours × 4 perspectives). Includes 720p@20fps video, multi-hot keyboard actions, and CC BY-NC-SA-4.0 license.