Provides 12 million verified source/edited image pairs with per-sample edit instructions and VQA-style quality checks for large-scale training and evaluation of instruction-based image editing models. Features a 1,000+ fine-grained edit taxonomy and multi-concept dense-supervision bundles; data is distributed as TAR shards for scalable extraction.
Presents a unified black-box reinforcement learning framework to train and optimize agents running inside complex execution harnesses. Uses sandbox-parallel rollouts, a serving proxy that captures model calls and reconstructs multi-turn trajectories as prefix trees, and adapted GRPO/PPO optimizers to achieve stable, scalable RL across heterogeneous harnesses.
Provides experimental and in-silico data for 1,440 de novo miniprotein binders designed by Anthropic's Claude models, including per-design kinetics, raw sensorgrams, structure-predictions, and design provenance. Includes two independent wet‑lab assessments and extensive per-design files; data released under CC BY 4.0.
Evaluates whether AI systems can independently carry out project-level scientific research by progressively removing human methodological guidance across 60 tasks in 11 domains. Built with expert review, sandbox execution, and multi-agent–model scoring to measure innovation and autonomous experimental execution.
Introduces SemComp-Bench: a benchmark and VLM-based evaluation protocol for measuring outcome achievement and task-relevant semantic grounding in instruction-driven video generation. Ships with SemComp-Data, curated image–instruction–outcome triplets and OA/GR scoring.
A dynamically quantized GGUF build of Ornith-1.5-35B optimized for agentic code-fixing and multi-turn conversations: targets 4-bit/≈22GB deployments, includes a vision projector, a custom importance matrix and a concise chat template.
Turns natural-language PLC requirements into verified, runnable IEC 61131-3 Structured Text by driving a closed loop of generation, compilation, deployment, and behavioral verification on a live OpenPLC runtime. The verification-gated harness forces inputs, traces execution, repairs failures, and renders ladder diagrams plus process simulation to raise dynamic runtime pass rates.
Contains ~2 million human pairwise preference judgments comparing images generated from text prompts; each example pairs two images with a preferred/tie label and is formatted for preference learning, reward-model training, and evaluation.
Proposes FACET, a framework that synthesizes verifiable terminal tasks by reconstructing scenario intent and grounding instruction, solution, and verifier in a shared executable container state. Key features include environment-first generation, execution-based validation, and targeted repair to preserve source intent and cross-artifact consistency.
Evaluates whether coding agents can modify real scientific software while preserving domain-specific scientific contracts. Contains 119 repository-level tasks across 98 GitHub projects and 20 scientific domains, measures reproducible edits in pinned Docker images, and analyzes recurring failure modes.
Evaluates visual reasoning in video generation models using 27 photorealistic tasks (810 instances), a two-level taxonomy of domains and skill tags, and task designs that enforce valid intermediate trajectories and calibrated difficulty.
Provides 2-bit quantized weights of Qwen3.8-27B (~10.15 GB) for local deployment, enabling the full 27B parameter model to run on a single 24 GB GPU with long-context support. Delivered as safetensors plus a companion SGLang runtime; measured to match FP8 reference on common benchmarks with small or no quality loss.