AIAny
Icon for item

Ropedia Xperience 2

Pairs metric-scale 3D scans of real environments with egocentric task recordings, estimated body and hand motion, and hierarchical annotations for physical AI research. The first release contains 126 scenes; the dataset is licensed CC BY-NC 4.0.

Introduction

Physical AI needs more than realistic scenes or demonstrations alone: a robot must connect what an environment looks like with how people act in it. The dataset’s central idea is to capture both in a shared geometric frame, making real-world spaces and human behavior jointly useful for simulation, robot learning, and evaluation.

What Sets It Apart
  • The collection combines 3D scene reconstructions with first-person task recordings, rather than treating environment assets and behavior data as separate resources. This can support experiments that transfer from observed human actions to simulated robot trajectories.
  • Its 1,589 released scans and collection inventory of 4,230 recordings across 74 tasks provide varied indoor and public-space settings. The recordings include estimated body and hand motion, device trajectories, and task annotations.
  • The reconstructions also support depth and geometry, 3D object detection, and spatial reasoning benchmarks, allowing the same environments to serve both data generation and evaluation.
Who It’s For—and the Trade-Off

A good fit for researchers building embodied-AI or robot-learning pipelines that need real-scene geometry paired with human demonstrations. It is less suitable for commercial use under the CC BY-NC 4.0 license, or for work requiring ground-truth motion capture: body and hand motion are estimated, and automatically generated captions can be inaccurate. The first online batch contains 126 scenes, not the full released collection.

Information

  • Websitehuggingface.co
  • OrganizationsRopedia Research Team
  • AuthorsHao Li, Fangzhou Hong, Zhaoxi Chen, Hui En Pang, Kairui Hu, Mingze Sun, Runmao Yao, Xinhao Ji, Xiyuan Zheng, Xuanli Chen …
  • Published date2026/11/13

More Items

Hugging Face

Provides about 10,000 OpenUSD objects for robotics simulation, including articulated and static assets with physics properties and robot-interaction annotations.

Turns LLMs’ physical knowledge into video training data using simulator constraints, physical verification, and iterative correction. It also repairs physical errors in generated videos and releases 100K videos spanning 2,500 physical events.

Hugging Face

Tests whether AI agents can interpret complex visual files, synthesize information across documents, and produce finished professional deliverables. Its 10 public tasks span distinct domains and require multimodal perception and multi-step tool use.