AIAny
Icon for item

ZefanCai/Open-Jev

Maps a state and question to typed probabilistic decisions (choice distributions, yes/no probabilities, or scored/ordinal outputs) across controlled synthetic tasks. Offers multiple frozen configs with train/calibration/validation/test/OOD splits, Parquet + raw JSONL exports, and reproducible manifests and provenance.

Introduction

Most datasets supply inputs and a single target label; this corpus supplies typed decision rows that preserve the original state, question, ordered options and numeric decision targets so models can return calibrated probabilities and multiple decision heads.

What Sets It Apart
  • Explicit typed decisions: each row encodes Choice (probability over candidates), Noul (yes/no probability) or Score (ordinal/numeric), enabling direct probability estimation and calibration workflows.
  • Multi-config frozen releases: twelve frozen configs and dozens of splits (train/calibration/validation/test/OOD) cover controlled domains such as customer-support routing, simple games (Snake, tic-tac-toe), simulated browser/drone controls, citation verification, entity-alignment and extraction tasks. Example counts: release-v2-redistributable (79,116 train; 113,568 total), browser-drone expansion (108,624 train; 160,797 total); the original frozen release used to train 2B/9B runs had 80,816 train rows and 115,821 rows across splits.
  • Reproducibility and provenance: raw JSONL.gz, Parquet exports, original manifests, audit artifacts and a REPRODUCTION.md let you reconstruct exact mixtures; generated records are CC0-1.0 and source code is MIT.
  • Serving and evaluation focus: records are designed for decision-model training, calibration and inspection (the Open-Jev decision interface reads one forward pass per question and returns calibrated option probabilities). Guidance is explicit about what fields can be used as model input (use state, question, kind, options; do not expose metadata/targets to models).
Who it's for and trade-offs

Great fit if you are training, calibrating or auditing models that must output explicit decision probabilities (e.g., decision heads, rerankers, agent action selectors) or benchmarking calibration and multi-head decision behavior. Also useful for building and testing deterministic candidate-extraction + typed selection pipelines. Look elsewhere if you need large-scale natural web scrapes, private mailbox contents, multimedia raw videos, or production-grade flight control data — the tasks are controlled/synthetic and several control corpora have not been used for model training. Some configs overlap and certain source rows (e.g., Wikispeedia) are excluded from public projections, so reproduce exact frozen mixtures if you need byte-for-byte parity.

More Items

Provides a unified data and evaluation suite for measuring gameplay capabilities across short, medium, and long temporal horizons. Includes an automated annotator, a 5,000-hour AAA gameplay dataset with temporally aligned frames, actions and multi-horizon instructions, and a reproducible offline + stepwise online benchmark.

Hugging Face

Provides 1,274 hours of head-mounted egocentric video paired with seven-point IMU arm tracking (24 Hz orientation; raw accel/gyro/mag on a subset), packaged for embodied-AI and egocentric-vision research. Key features: torso-relative pose via chest reference, separate Parquet IMU repo for efficient joins, CC-BY-4.0 license; heavy class skew and limited contributor diversity are important constraints.

Transforms source code into verifiable, reusable agent skills by extracting atomic operations, workflows, and recurring patterns and validating them via source-body-blind reconstruction. Produces CodeSkillBank (1,006,822 accepted records from 19,769 GitHub repos) and yields ~11.7% average downstream improvement.