Converts large-scale egocentric human videos into robot-format pseudo-action trajectories and introduces ACE-EGO-0, a VLA pretraining framework that unifies camera-space actions, morphology conditioning, and reliability-aware weighting to jointly learn from noisy human and high-quality robot data for improved robotic manipulation transfer.
AI Dataset2026
Provides 130k+ bimanual teleoperation trajectories for robot imitation learning, recorded on low-cost YAM two-arm rigs and shared as MCAP episodes with subtask annotations, training code, and checkpoints.
AI Video Papers2026
Serves interactive, long-lived streaming video-generation sessions by jointly scheduling session placement and GPU autoscaling to meet tight per-chunk latency. Combines migration-aware placement, load-driven autoscaling, coalesced chunk processing, GPU–CPU offloading and NCCL GPU–GPU migration; reports ~37% reductions in worst-case per-chunk latency and GPU operating cost.
AI Dataset2026
Provides a small, manually annotated benchmark for evaluating vision–language models that convert robot and egocentric manipulation videos into timestamped subtask segments and concise action labels. Contains 100 episodes, 743 gold segments, and MP4 bytes embedded per row.
AI Dataset2026
Zeren Jiang, Yushi Lan +9Visual Geometry Group, University of Oxford, Nanyang Technological University +1
Provides multiview synthetic RGB video clips with per-frame depth, instance masks, dense long-range 3D point tracks, camera poses, and SMPL‑X human pose/shape labels for 4D reconstruction, tracking, and geometry-aware novel-view synthesis. Includes ~4.7K clips (1.4M frames) and is licensed for AI training.
AI Dataset2026
Provides ~2 million instruction-aligned video-edit pairs for training and evaluating instruction-based video editing and generation models. Covers multi-task and structural edits (e.g., camera/subject movement), produced via a synthesis pipeline with progressive filtering; licensed CC BY-NC-4.0.
AI Dataset2026
Multimodal video dataset for text-to-video and video-to-video research: about 2 million short English videos and extracted frames for instruction-based video editing and generation. Hosted on Hugging Face and licensed CC BY‑NC 4.0 (non-commercial).
AI Dataset2026
Provides 600,000+ first-person player-round videos (10,000+ hours) with per-frame keyboard, mouse-delta, and 3D trajectory annotations in WebDataset shards—built for training world models, action-conditioned video, and imitation-learning workflows (non-commercial license).
AI Dataset2026
Provides synchronized four-perspective Rocket League match recordings with per-frame H.264 video, player action streams, event logs, and privileged physics state — released as WebDataset shards in a ~4,000-hour slice (1,000 match-hours × 4 perspectives). Includes 720p@20fps video, multi-hot keyboard actions, and CC BY-NC-SA-4.0 license.
AI Dataset2026
Provides ~494.7 hours of trimmed native PC/console gameplay screen recordings organized by game, with per-session clips plus input and per-frame event annotations. Each workflow includes clip.mp4, events.json, frame_events.json, and metadata — suitable for training vision-action, behavior-cloning, and gameplay understanding models.
AI Dataset2026
Provides anonymized multi-domain user behavior sequences and content metadata (short video, ads, e-commerce, live) for cross-domain recommendation, semantic-ID mapping, and content-understanding tasks. Key tables include per-user multi-domain behavior (~500k rows), pid→three-segment semantic IDs, captions, and level-3 tags; all item IDs are hashed for privacy.
AI Model2026
Diffusion-based generative model for scene and video synthesis, providing full Diffusers checkpoints and scene LoRA for fast adaptation. Includes Stage‑1 nano (1.3B) and pro (5B) variants and modular transformer/VAE components.