arXiv News

First-hand information for everyone

Site

AboutPrivacy PolicyTerms of Use

© 2026 arXiv News

TOME‑Math turns 2,118 university textbooks into a 380‑000‑record math‑learning dataset that lifts large‑language‑model performance across six benchmarks | arXiv News

arXiv News

EnglishJapanese

Switch language

EnglishJapanese
Loading account…

First-hand information for everyone

Back to front page
Natural Language ProcessingEnglishPublished

TOME‑Math turns 2,118 university textbooks into a 380‑000‑record math‑learning dataset that lifts large‑language‑model performance across six benchmarks

November 1, 2026arXiv: 2610.40394v1

TOME‑Math turns the text of 2,118 university‑level mathematics textbooks into a structured corpus of about 380,000 proof–supervision records. Each record keeps the chapter sequence, links between theorems and their proofs, references to supporting propositions, and a clear trail back to the original source book.

This structured data was fed into a Qwen3‑30B‑A3B‑Base language model. After one‑epoch training on the full TOME‑Math set, the model’s average accuracy on six held‑out math benchmarks increased from 29.17 % to 45.83 %. That performance surpasses all three published instruction‑data baselines tested in aggregate.

The size and structure of the corpus are shown in a table that lists TOME‑Math’s 380,292 questions and answers, gained from 2,118 titles, alongside other datasets. The table also highlights that the records retain chapter order, reference links, and provenance.

Table of TOME‑Math resource sizes and metadata, illustrating its 380,292 QA pairs from 2,118 textbooks with preserved chapter sequence, links and provenance details.
ResourceSize
Source
Supervision
Metadata / structure
[0pt][0pt] Mathematical instruction data
MATH [2021]12.5K QACompetitionsSolutionsSubject, difficulty
MetaMathQA [2023]395K QAGSM8K, MATHSolutionsSeeds, augmentation types
OpenMathInstruct-2 [2024a]14M QAGSM8K, MATHSolutionsSource labels
NuminaMath-CoT [2024]∼860K QAExams, web, syntheticSolutionsSource labels
[0pt][0pt] Textbook and knowledge-informed resources
MathPile [2024]9.5B tokensBooks, papers, webTextSources, file paths
CollegeMath [2024]4,099 QA9 textbooksShort answersBook/section/exercise IDs
[0pt][0pt] Proof resources and evaluation
NaturalProofs [2021]32K proofs2 textbooks + webNL proofsReference graph
ProofNet [2023]371 examplesTextbooks, PutnamNL + Lean stmt.Book/exercise IDs
Lean-GAP [2026]430 problems1 textbookLean statementsSection/exercise IDs
AlgGeoTest [2025]456 questionsStacks ProjectProof judgmentsStatement tags
TOME-Math (ours)380,292 QA2,118 textbooksNL + local proofsChapter order, refs, provenance
Table 1. Table 1 shows TOME‑Math’s 380,292 QA pairs derived from 2,118 textbooks, highlighting retained chapter order, proposition–proof links, and source provenance.Fang, Youqing, Hua, Zhouqi, Tang, Yinhao, Gu, Yuzhe, Kong, Lingkai, Liu, Bin et al. · arXiv:2610.40394v1 · Table 1: · CC BY 4.0

An evaluation table compares the model fine‑tuned on TOME‑Math with versions fine‑tuned on other mathematics corpora. It reports unweighted mean scores across six distinct tests, demonstrating the clear lift in performance when using TOME‑Math.

Table of six benchmark average scores for models fine‑tuned on different corpora; the TOME‑Math–fine‑tuned model achieves a 45.83 % mean, higher than the 29.17 % base.
SFT supervision corpusTOME-LFTOME-Obj.MiniF2FProofNetMATH-500AIME-26Avg.
None (Qwen3-30B-A3B-Base)13.2532.9334.4517.1468.808.4429.17
OpenMath1 (1.82M)20.1633.8622.8719.2570.408.2129.13
MetaMath (395k)28.7334.6640.7022.5571.209.9834.64
MathInstruct (262k)35.8740.6952.0532.9373.0511.9841.10
TOME-Math (ours; 364.6k)43.8643.9657.4342.9876.5510.1945.83
Table 2. Table 2 compares the Qwen3‑30B‑A3B‑Base model fine‑tuned on TOME‑Math against four other SFT corpora, showing an average score of 45.83 % versus 29.17 % for the untrained base.Fang, Youqing, Hua, Zhouqi, Tang, Yinhao, Gu, Yuzhe, Kong, Lingkai, Liu, Bin et al. · arXiv:2610.40394v1 · Table 2: · CC BY 4.0

This work shows that preserving textbook structure and sourcing can materially improve a large language model’s ability to reason through mathematical proof problems.

Source paper

Scaling Mathematical Proof Supervision from Structured Textbooks

Natural Language ProcessingArtificial Intelligence
View on arXiv