AIAny
Icon for item

bones-studio/seed

Provides an annotated multimodal human-motion dataset for language-to-action and robotics research, with BVH and MuJoCo files plus recordings targeted at Unitree-G1 and NVIDIA-SOMA platforms. Covers locomotion, gestures, dance and object interaction with English annotations and 100K–1M samples.

Introduction

Why this matters Most embodied AI and language-to-action research stalls for lack of datasets that link natural language to whole-body, platform-specific motion. SEED fills that gap by combining motion-capture trajectories, formatted robot-ready files, and English action annotations so models can be trained end-to-end from text to executable motion.

What Sets It Apart
  • Multi-target outputs: includes BVH and MuJoCo artifacts plus recordings and assets aimed at Unitree-G1 and NVIDIA-SOMA — so what: eases transfer from learned policies to real/sim robot stacks without manual reformatting.
  • Broad motion coverage with annotations: locomotion, gesture, dance and object interaction labeled in English — so what: supports both low-level control tasks and higher-level language-conditioned behavior learning.
  • Practical scale and provenance: tagged as 100K–1M samples, hosted on Hugging Face with thousands of downloads and community likes — so what: large enough for representation learning while reflecting an applied robotics focus.
Who It's For and Tradeoffs

Great fit if you are training or evaluating language-conditioned controllers, motion-generation models, or sim-to-real pipelines for humanoid/legged platforms and need platform-ready assets and annotated trajectories. Look elsewhere if you need a dataset with a permissive, well-known open license (SEED’s license is unspecified/other) or if your work targets purely vision-only video tasks without motion control.

Where It Fits

SEED sits between pure motion-capture corpora (which may lack robot-format outputs) and robotics benchmarks (which often lack rich language annotations). Use it when your experiment needs both annotated semantics and robot-executable motion representations.

Information

  • Websitehuggingface.co
  • Organizationsbones-studio
  • Published date2026/03/10

More Items

Evaluates generalist robot manipulation policies across simulation and real-world settings using 42 sim tasks and 18 real tasks; measures generalization, memory, precision, long-horizon execution and open-vocabulary instruction following, and provides a cloud-accessible real-world evaluation system with XPolicyLab integration and a public leaderboard.

Reconstructs historical experience into latent memory tokens and weaves short- and long-term latent memories directly into vision-language-action reasoning to improve long-horizon robotic manipulation. Uses a four-part pipeline (curator, seeker, condenser, weaver) so memory participates natively in multimodal action formation.

Pretrains a DiT-based Mixture-of-Experts video foundation model for embodied intelligence by augmenting internet videos with robot-centric footage and using a multi-dimensional reward system to prioritize physical realism and task completion while scaling MoE for better capacity vs. inference trade-offs.