AI Dataset2026
Transforms articulated 3D asset creation into a programmatic, LLM-driven code-generation workflow that produces objects with semantic parts, robust geometry, and physical joints. Includes CLI generation, a local viewer, and pipelines for large-scale dataset contribution.
Embodied AI2026
Reconstructs camera poses and dense 3D point clouds from video streams using a feed‑forward foundation model. Combines a Geometric Context Transformer (anchor + local window + trajectory memory) with paged KV‑cache attention to enable stable, long‑sequence streaming inference (~20 FPS at 518×378).
AI Dataset2026
Provides a large-scale multimodal embodied dataset (vision, depth, hand/arm kinematics, tactile) captured with an exoskeleton glove and egocentric sensors; organized as clip-level Zarr volumes for manipulation, imitation learning, and vision–action research. Includes both high-precision glove measurements and natural bare-hand clips; sizable storage required.
AI Dataset2026
Provides aligned urban driving sensor streams (camera frames, LiDAR, radar and HD‑map / lanelet2 annotations) for multimodal perception, tracking and mapping research. Expert-generated labels under CC BY‑NC‑4.0 and hosted on Hugging Face.
AI Dataset2026
Large-scale synthetic video dataset of physically simulated multi-object interaction scenes for training and evaluating models on physical reasoning, depth and optical-flow estimation, instance segmentation, and physics-grounded captioning. Provides RGB + lossless depth, per-frame instance masks, per-object physics annotations (NPZ), VLM-grounded captions, and USD scene files — useful for world-model and simulation-to-real work; commercial use permitted.
AI Dataset2026
Open egocentric multimodal dataset for embodied AI and robot learning captured on commodity iPhone Pro: ~200 hours and ~10M RGB frames with LiDAR depth, ARKit 6‑DoF poses, IMU, two‑hand MANO mocap, room meshes, and hierarchical action captions.
AI Dataset2026
Provides 10,000 articulated 3D objects in URDF for robotics and embodied-AI research. Generated by the Articraft agent and released under CC-BY-4.0, the dataset targets simulation, manipulation, kinematics evaluation, and training of embodied agents.
AI Model2026
Performs fast, high-quality vision–language grounding: given an image plus a natural-language prompt it returns bounding boxes or points for referred objects. Uses Parallel Box Decoding for parallel coordinate prediction (higher throughput) and targets research/non-commercial use.
AI Model2026
Generates and reasons about multimodal physical-world content—text, images, video, audio, and robot/action trajectories—conditioned on combinations of text, image, video and action inputs. The 64B “Super” variant targets Physical AI use cases and supports vLLM‑Omni, Diffusers, and action prediction.
Omnimodal world model that jointly processes and generates text, images, video, audio, and action trajectories for physical AI. Uses a mixture-of-transformers to combine autoregressive reasoning and diffusion-based multimodal generation; released open-source with checkpoints, datasets and benchmarks for robotics and simulation.
Evaluates multimodal LLMs on streaming egocentric video for spatial intelligence using 1,680 human-annotated questions across 348 videos; organizes tasks into four hierarchical levels (perception → tracking → simulation → allocentric mapping) and highlights allocentric mapping as the main bottleneck.
Trains a GPT-style causal Transformer on a 2-billion-frame retargeted motion corpus to enable zero-shot whole-body motion tracking and control. By scaling both data and model capacity, it tracks highly dynamic behaviors while generalizing to unseen motions; accepted to CVPR 2026.