A useful way to test a coding agent is to give it a bug that behaves like one found in real development—not one invented solely to look plausible. This dataset builds tasks by turning patterns from historical fixes into injected bugs, then retaining cases whose test suites expose a regression.
What Makes It Useful
- Fixes become bug-induction supervision. Reversing real repair patterns grounds generated failures in actual code changes, rather than relying only on free-form prompts to invent defects.
- Tasks are prepared for replay. Each instance records the clean base commit, the bug-injection patch, the reference repair, and relevant test identities. This makes it possible to reproduce the injected state and verify the repair separately.
- Evaluation retains test behavior. The dataset records tests that fail before repair and pass afterward, alongside tests that should continue passing. That helps distinguish a genuine fix from a patch that merely changes code or breaks unrelated behavior.
Who It’s For
A good fit for researchers comparing coding agents on reproducible repository-level repair tasks, or studying synthetic task generation. Look elsewhere if you need non-Python coverage, bugs that cannot be detected by the available test suites, or tasks independent of the upstream repositories’ images and licenses. The release covers 53 Python repositories, so its language and repository diversity are bounded.