Tag
RePro integrates Lean-oriented neural automated theorem provers into benchmark rewriting to ensure problem validity and answer correctness for reliable evaluation of LLMs in mathematical problem solving.
AdvancedMathBench is a new benchmark suite for evaluating LLMs on advanced mathematical proof generation and verification. It includes ProverBench for generation and VerifierBench for verification, demonstrating that current models like GPT-5.5-xhigh achieve only modest performance.
Researchers from Oxford, Cambridge, MIT, CMU and other institutions conduct a mixed-methods study examining how people integrate AI tools into mathematical proof formalization workflows, finding that participants generally achieve higher formalization accuracy with AI assistance while preferring to maintain high-level human control over the proof discovery process.
Research Math Agents (RMA) is an agentic framework for automated reasoning on research-level mathematical problems, achieving state-of-the-art results on the First Proof benchmark by solving 8 out of 10 problems, outperforming strong baselines like GPT-5.2R and Aletheia.
ProofGrid is a benchmark suite that evaluates LLM reasoning through machine-checkable proofs using minimal formal notation, with tasks in proof writing, checking, and gap-filling, revealing progress and remaining limits including epistemic instability.