Evaluates whether coding agents can modify real scientific software while preserving domain-specific scientific contracts. Contains 119 repository-level tasks across 98 GitHub projects and 20 scientific domains, measures reproducible edits in pinned Docker images, and analyzes recurring failure modes.
Finds token- and API-cost-saving harness mechanisms for long-horizon coding agents using automated recursive self-improvement; packages four surviving mechanisms (action fusion, context compaction, observation archiving, delegated reading) to cut recorded token traffic ~44.7–49.0% and API cost by about one third while preserving most capability.