AIAny
Icon for item

Asimov Agentic

A compact evaluation dataset and harness for testing agentic AI on safety-critical robotics tasks. Includes multimodal episodes in parquet format, task-specific eval scripts (gauge reading, human safety monitoring, VLA estimators), and TFDS/Hugging Face integration for reproducible safety evaluations.

Introduction

Oops! Something went wrong

[next-mdx-remote-client] error compiling MDX: Unexpected character `1` (U+0031) before name, expected a character that can start a name, such as a letter, `$`, or `_` More information: https://mdxjs.com/docs/troubleshooting-mdx

Information

  • Websitehuggingface.co
  • OrganizationsGoogle, ASIMOV Benchmark
  • AuthorsPierre Sermanet, Anirudha Majumdar, Alex Irpan, Dmitry Kalashnikov, Vikas Sindhwani
  • Published date2026/07/21

Categories

More Items

Hugging Face

Provides structured egocentric manipulation signals from smartphone videos: MANO 3D hand reconstructions, metric camera trajectories, and fine-grained atomic action segments (full release ≈2,000 hours planned). Supplies aligned hands.npz, camera_traj.npz, undistorted intrinsics and segment annotations for embodied-learning pipelines.

Hugging Face

A compact dataset of prompt templates and examples designed to teach LLMs to consistently report model identity fields (model ID, name, creator, family, architecture, parameter count, knowledge cutoff). Includes regex markers, usage guidance, example replacements, and a small personalization script for fine‑tuning or runtime substitution.

Hugging Face

A multiple-choice benchmark for evaluating language-model arithmetic: 1,000 continuation-style elementary word problems (4 choices, balanced labels) organized by topic, grade band, and difficulty. Designed for base-model continuation log-likelihood scoring; released under Apache-2.0.