AIAny
Icon for item

Scaling Mathematical Proof Supervision from Structured Textbooks

Turns university mathematics textbooks into structured proof-training data while preserving chapter order, proposition–proof links, and dependencies. The authors report a 16.7-point average gain over the base model across six evaluations.

Introduction

Most proof-training datasets discard the context that makes a proof meaningful: what came before it in the course, which propositions it relies on, and where its claims originated. The central idea here is that textbook structure is not just metadata; it can shape the curriculum a model learns from. The reported results suggest that organizing supervision may matter as much as accumulating more examples.

Key Findings
  • The corpus converts 2,118 university mathematics textbooks into 380,292 proof-supervision records, including explicit textbook proofs and intermediate reasoning obligations inferred from proof gaps.
  • Records retain chapter order, proposition–proof links, dependency references, and source provenance. This gives researchers a way to study curriculum and evidential structure rather than treating every problem–answer pair as independent.
  • Fine-tuning Qwen3-30B-A3B-Base on the 364,631-example training split raised the unweighted mean across six evaluations from 29.17% to 45.83%. The model led on five benchmarks and ranked second on AIME 2026.
  • The comparison is notable for data efficiency: the paper reports that the corpus outperformed OpenMath1, despite OpenMath1 containing roughly 4.8 times as many examples. Because the datasets differ in more than structure, this comparison alone does not establish which factor caused the gains.
Method and Trade-offs

The pipeline parses and organizes textbooks, extracts source-grounded theorem, lemma, and definition proofs, then identifies substantive gaps and turns them into standalone proof tasks. Structural checks and source-conditioned review are used to catch extraction errors. This approach provides unusually rich provenance, but it also depends on automated PDF parsing and model-assisted extraction; errors in those stages can affect the resulting supervision. The reported benchmark gains are evidence for this dataset and training setup, not a guarantee of similar improvements across models or mathematical domains.

Who It’s For

A strong fit for researchers studying mathematical reasoning, curriculum learning, proof generation, or how training-data organization affects language models. Look elsewhere if you need a general-purpose math problem bank, a ready-made model, or independently verified proof data without an extraction pipeline.

Information

  • Websitearxiv.org
  • OrganizationsUniversity of Science and Technology of China, Fudan University, Shanghai AI Laboratory, Shanghai Jiao Tong University
  • AuthorsYouqing Fang, Zhouqi Hua, Yinhao Tang, Yuzhe Gu, Lingkai Kong, Bin Liu, Weiming Zhang, Kai Chen, Yanan Sun, Wenwei Zhang
  • Published date2026/10/29

More Items

Lets AI agents read task-relevant evidence from external content instead of receiving entire documents by default. Intent tracking, adaptive readers, and an exposure budget reduce token use and latency while retaining a faithful full-view fallback.

Trains language models to retrieve, study, and apply knowledge from textbooks through reinforcement learning. The approach raises overall mathematical proof accuracy from 51.5% to 79.5% and also improves results on two long-context benchmarks.

Hugging Face

Provides 6,015 screened, repaired Objaverse models in GLB tiers for web, games, mobile, and desktop engines, with LODs and collision meshes. Each model retains its CC0 or CC BY license and author attribution.