First-hand information for everyone
TOME‑Math turns the text of 2,118 university‑level mathematics textbooks into a structured corpus of about 380,000 proof–supervision records. Each record keeps the chapter sequence, links between theorems and their proofs, references to supporting propositions, and a clear trail back to the original source book.
This structured data was fed into a Qwen3‑30B‑A3B‑Base language model. After one‑epoch training on the full TOME‑Math set, the model’s average accuracy on six held‑out math benchmarks increased from 29.17 % to 45.83 %. That performance surpasses all three published instruction‑data baselines tested in aggregate.
The size and structure of the corpus are shown in a table that lists TOME‑Math’s 380,292 questions and answers, gained from 2,118 titles, alongside other datasets. The table also highlights that the records retain chapter order, reference links, and provenance.
| Resource | Size |
|---|
| Source |
|---|
| Supervision |
|---|
| Metadata / structure |
|---|
| [0pt][0pt] Mathematical instruction data |
|---|
| MATH [2021] | 12.5K QA | Competitions | Solutions | Subject, difficulty |
|---|
| MetaMathQA [2023] | 395K QA | GSM8K, MATH | Solutions | Seeds, augmentation types |
|---|
| OpenMathInstruct-2 [2024a] | 14M QA | GSM8K, MATH | Solutions | Source labels |
|---|
| NuminaMath-CoT [2024] | ∼860K QA | Exams, web, synthetic | Solutions | Source labels |
|---|
| [0pt][0pt] Textbook and knowledge-informed resources |
|---|
| MathPile [2024] | 9.5B tokens | Books, papers, web | Text | Sources, file paths |
|---|
| CollegeMath [2024] | 4,099 QA | 9 textbooks | Short answers | Book/section/exercise IDs |
|---|
| [0pt][0pt] Proof resources and evaluation |
|---|
| NaturalProofs [2021] | 32K proofs | 2 textbooks + web | NL proofs | Reference graph |
|---|
| ProofNet [2023] | 371 examples | Textbooks, Putnam | NL + Lean stmt. | Book/exercise IDs |
|---|
| Lean-GAP [2026] | 430 problems | 1 textbook | Lean statements | Section/exercise IDs |
|---|
| AlgGeoTest [2025] | 456 questions | Stacks Project | Proof judgments | Statement tags |
|---|
| TOME-Math (ours) | 380,292 QA | 2,118 textbooks | NL + local proofs | Chapter order, refs, provenance |
|---|
An evaluation table compares the model fine‑tuned on TOME‑Math with versions fine‑tuned on other mathematics corpora. It reports unweighted mean scores across six distinct tests, demonstrating the clear lift in performance when using TOME‑Math.
| SFT supervision corpus | TOME-LF | TOME-Obj. | MiniF2F | ProofNet | MATH-500 | AIME-26 | Avg. |
|---|---|---|---|---|---|---|---|
| None (Qwen3-30B-A3B-Base) | 13.25 | 32.93 | 34.45 | 17.14 | 68.80 | 8.44 | 29.17 |
| OpenMath1 (1.82M) | 20.16 | 33.86 | 22.87 | 19.25 | 70.40 | 8.21 | 29.13 |
| MetaMath (395k) | 28.73 | 34.66 | 40.70 | 22.55 | 71.20 | 9.98 | 34.64 |
| MathInstruct (262k) | 35.87 | 40.69 | 52.05 | 32.93 | 73.05 | 11.98 | 41.10 |
| TOME-Math (ours; 364.6k) | 43.86 | 43.96 | 57.43 | 42.98 | 76.55 | 10.19 | 45.83 |
This work shows that preserving textbook structure and sourcing can materially improve a large language model’s ability to reason through mathematical proof problems.