autoformalization

Tag

Cards List
#autoformalization

Closing the Loop: Formally Verified Law as a Reward Signal for Self-Improving Legal AI

arXiv cs.LG ↗ · 2026-06-24 Cached

This paper presents an architecture that uses formally verified law as a reward signal for training legal AI, adaptively autoformalizing legal rules into a formal calculus and employing a verifier to ensure provable correctness, demonstrated on German and US law examples.

0 favorites 0 likes
#autoformalization

Evaluating the Robustness of Proof Autoformalization in Lean 4

arXiv cs.CL ↗ · 2026-06-16 Cached

This paper evaluates the robustness of proof autoformalization models in Lean 4 under global and local perturbations, finding that current LLM-based models are sensitive to perturbations and often fail to faithfully reflect local changes.

0 favorites 0 likes
#autoformalization

PrologMCP: A Standardized Prolog Tool Interface for LLM Agents

arXiv cs.AI ↗ · 2026-06-16 Cached

Introduces PrologMCP, an open-source server that exposes Prolog as a stateful tool via the Model Context Protocol, enabling LLM agents to delegate reasoning to a symbolic solver. Evaluation shows competitive or superior accuracy on deductive reasoning tasks compared to frontier reasoning LLMs.

0 favorites 0 likes
#autoformalization

Formalizing Numerical Analysis: An Agent Pipeline and Quality Audit Beyond Kernel Acceptance

arXiv cs.AI ↗ · 2026-06-15 Cached

This paper presents an agent pipeline for formalizing a numerical analysis textbook in Lean 4 and introduces a quality audit framework that evaluates semantic correctness and library reuse beyond kernel acceptance, revealing common unfaithful formalization patterns.

0 favorites 0 likes
#autoformalization

Sorries Are Not the Hard Part: An Expert-Review Case Study of a Semi-Autonomous Formalization

arXiv cs.AI ↗ · 2026-06-15 Cached

This paper presents a case study of using a large language model (Claude Code) to formalize Grothendieck's vanishing theorem in the Lean theorem prover. It finds that while agents can produce verified code, they struggle with definitions and API design, emphasizing the need for expert review beyond mere compilation.

0 favorites 0 likes
#autoformalization

Characterizing initial human-AI proof formalization workflows

arXiv cs.AI ↗ · 2026-06-04 Cached

Researchers from Oxford, Cambridge, MIT, CMU and other institutions conduct a mixed-methods study examining how people integrate AI tools into mathematical proof formalization workflows, finding that participants generally achieve higher formalization accuracy with AI assistance while preferring to maintain high-level human control over the proof discovery process.

0 favorites 0 likes
#autoformalization

ATLAS: Autoformalized Textbook Library At Scale

Hacker News Top ↗ · 2026-05-28 Cached

ATLAS is a large-scale Lean 4 library of textbook mathematics autoformalized by LLMs, covering 26 books with over 46,000 declarations. It provides reusable formal building blocks for human and machine-driven formalization.

0 favorites 0 likes
#autoformalization

MathAtlas: A Benchmark for Autoformalization in the Wild

arXiv cs.AI ↗ · 2026-05-15 Cached

MathAtlas is a large-scale benchmark for autoformalization of graduate-level mathematics, containing ~52k theorems and definitions extracted from 103 textbooks, with a mathematical dependency graph of ~178k relations. Experiments show state-of-the-art models achieve at most 9.8% correctness, highlighting the difficulty.

0 favorites 0 likes
← Previous
← Back to home

Submit Feedback