@dabit3: if you’re not following @imjaredz you should change that now
Summary
This article presents Demonstrandum, a verification-first multi-agent AI mathematics pipeline that produces mechanically checkable artifacts, including refutations and proofs of conjectures with Lean 4 kernel verification.
View Cached Full Text
Cached at: 07/24/26, 11:07 AM
if you’re not following @imjaredz you should change that now
demonstrandum-research/artifacts
Source: https://github.com/demonstrandum-research/artifacts
Demonstrandum — wave-1 verified artifacts
Demonstrandum is a verification-first multi-agent AI mathematics pipeline, directed and audited by John Erlbacher (Independent Researcher). Its house rule: no claim is accepted on an AI’s word — the unit of progress is an artifact on disk plus an independently written checker that accepts it, so every result below is mechanically checkable by you, with zero trust in any AI or in the author. This repository began as the complete 14-result wave-1 artifact bundle (11 refutations of published conjectures, two proofs of published conjectures, one numerical record), with six accompanying papers and a one-command master verification battery. It now also carries row 15, the Erdős problem #866 release (2026-07-08) — the eventual value of the Choi–Erdős–Szemerédi constant, h₄(n) = 4 for all n ≥ 331,777, kernel-verified in Lean 4, with improved g₅/h₅ bounds and a 298-cell dual-engine SAT-certified exact-value table — plus the later strong-majority five- and six-color kernel packages. Those later packages have their own rebuild instructions and are not silently included in the legacy master battery.
- Exact claims, verbatim frozen statements, per-result caveats:
RESULTS.md - What each check does and does not establish (guide for an outside mathematician):
VALIDATION.md - Current bundle concept DOI: 10.5281/zenodo.20673864; July 8 v3 snapshot: 10.5281/zenodo.21269439
- Strong-majority five-color release:
papers/five-colors/, concept DOI 10.5281/zenodo.21316623 - Strong-majority six-color predecessor:
papers/five-colors/six-color-artifact/ - Contact: John Erlbacher — [email protected] — ORCID 0009-0003-6851-4139
Results
Grades, defined precisely in RESULTS.md: kernel = the
entire claim is a Lean 4 theorem accepted by the Lean kernel with only the
three standard mathlib axioms; dual-checker = certificate accepted by ≥ 2
independently written checkers plus mutation testing; audit-panel = banked
runnable checker plus adversarial clean-room audits across model families.
| # | result | grade | paper | verify |
|---|---|---|---|---|
| 1 | IRIS Conjecture 6.1 (“NuevaMirada”) — refuted | dual-checker | — | python verify_all.py --only iris |
| 2 | Discrete Borsuk Conjecture 3 (arXiv:2508.20009) — disproved in Lean 4 | kernel | papers/borsuk/ | python verify_all.py --only borsuk |
| 3 | Graffiti Conjecture 143 — refuted | dual-checker | papers/graffiti-143-154/ | python verify_all.py --only g143 |
| 4 | Graffiti Conjecture 154 (std-dev reading) — refuted | dual-checker | papers/graffiti-143-154/ | python verify_all.py --only g154 |
| 5 | TxGraffiti/Davila Conjecture 9 — refuted | dual-checker | — | python verify_all.py --only dc9 |
| 6 | Pandey parity conjecture — refuted (both directions) | dual-checker | — | python verify_all.py --only gp/ |
| 7 | Solubilizer Conjecture A.1 (arXiv:2412.16177) — refuted | dual-checker | — | python verify_all.py --only a1/ |
| 8 | Solubilizer Conjecture A.13 — refuted | audit-panel | — | python verify_all.py --only a13 |
| 9 | Solubilizer Conjecture A.16 — refuted | audit-panel | — | python verify_all.py --only a16 |
| 10 | Sun Conjecture 4.6 (arXiv:2108.07723) — refuted | dual-checker | papers/sun-46/ | python verify_all.py --only sun |
| 11 | Koch–Narayan Conjecture 1 — refuted | dual-checker | — | python verify_all.py --only kn/ |
| 12 | C(13) ≥ 36 record (“no 5 on a sphere”) | dual-checker | papers/no5sphere-record/ | python verify_all.py --only no5 |
| 13 | Elizalde–Luo {1132, 3312} conjecture — proved in Lean 4 | kernel | papers/elizalde-luo/ | python verify_all.py --only eliz |
| 14 | Kurkov’s 2018 A000670 conjecture (Fubini-number sum) — proved | audit-panel | papers/kurkov-a000670/ | python papers/kurkov-a000670/checker.py |
| 15 | Erdős #866: h₄(n) = 4 for all n ≥ 331,777 (eventual CES constant); 4 ≤ h₄ ≤ 1000; g₅ ≤ 3,519,219; h₅ ≥ #{Fib ≤ n}+1; exact cells incl. g₅ = 4 on [15,23] | kernel (headline theorems) + certificate ([E]: dual-engine SAT, DRAT/LRAT via cake_lpr, 298 cells) | problems/p4-erdos866/paper/ | see problems/p4-erdos866/README.md |
Each result also carries an explicit “what this does NOT show” caveat in
RESULTS.md — claim calibration is part of the protocol.
Quickstart
Requirements: Python 3.10+ with numpy and sympy. Prebuilt Windows x64 Rust
checker binaries are included; on other platforms they are rebuilt
automatically when cargo is installed.
git clone https://github.com/demonstrandum-research/artifacts.git
cd artifacts
python verify_all.py # default battery: 33 checks, ~5-15 min
python verify_all.py --full # adds long redundant layers, ~25-30 min
python verify_all.py --strict # SKIPs become failures (full zero-trust mode)
python verify_all.py --list # list all checks; --only SUBSTR runs a subset
Expected final line without a local Lean build cache (the two Borsuk Lean checks SKIP with instructions rather than start a multi-hour mathlib build):
TOTAL: 31 PASS, 0 FAIL, 2 SKIP in ... s
WARNING: SKIPped checks mean the following results were NOT verified on this machine: Borsuk-C3
With the Lean build completed (next section): TOTAL: 33 PASS, 0 FAIL, 0 SKIP.
A SKIP always means “not verified on this machine” — the summary says so loudly.
Papers
Six wave-one papers accompany the legacy headline results. Each directory contains the LaTeX
source, the compiled PDF, build notes (BUILD.md), referee-round responses
(RESPONSES.md), and recompute scripts.
Discrete Borsuk — papers/borsuk/note.pdf
Counterexamples to a conjectured characterization of cubes. Brose, De Loera,
Lopez-Campos and Torres proved that the lattice Borsuk number of a bounded set
S ⊂ Z^d is at most 2^d, and conjectured (arXiv:2508.20009, Conjecture 3) that
it equals 2^d iff conv(S) is unimodularly equivalent to a cube. The four-point
set {(0,0), (1,0), (0,1), (3,5)} has all pairwise differences primitive, so
its lattice Borsuk number is 4 = 2^2, while its hull contains 7 lattice points
and is therefore equivalent to no square. The disproof is formally verified: a
~1100-line Lean 4 development over mathlib proves betaZ SA = 4,
latticeCount hullSA = 7, and conjecture3_false; the axiom audit reports
only the three standard axioms. Two further counterexamples (exact arithmetic,
not formalized) close the natural repair in dimensions 2 and 3.
Elizalde–Luo — papers/elizalde-luo/note.pdf
A proof of the Elizalde–Luo conjecture for nonnesting permutations avoiding
1132 and 3312. Elizalde and Luo (DMTCS 27:1, 2025) conjectured from data for
n ≤ 8 that the number of nonnesting permutations of {1,1,…,n,n} avoiding both
1132 and 3312 is 3^n − 3·2^(n−1) + 1. The paper proves the conjecture with an
elementary, self-contained argument (Dyck shape carrying a label permutation;
avoidance forces prefix-interval labels; a two-coloring condition on crossing
arcs), plus a second, bijective proof onto an explicit ternary language. Every
lemma was verified mechanically far beyond the original data range, including
an exhaustive check over all 57,657,600 nonnesting words at n = 8. The full
general-n theorem is now formalized in Lean 4 and accepted by the Lean kernel
(problems/p3-moonshot/elizalde-luo/lean/, theorem elizalde_luo_1132_3312;
no sorry, no native_decide, axiom audit reports only the three standard
mathlib axioms), so the result is graded kernel.
Sun 4.6 — papers/sun-46/note.pdf
The sign pattern of Sun’s trigonometric permanents. Zhi-Wei Sun (arXiv:2108.07723, Conjecture 4.6) conjectured sign patterns for two integer sequences arising from permanents of trigonometric matrices. Part (ii) — hence the conjecture as stated — fails at p = 29, the first prime beyond Sun’s published table: s_29 = 1,053,859 > 0 although 29 ≡ 5 (mod 12), and s’_29 = −4,806,838,304 < 0 although 29 ≡ 5 (mod 8). Every value is certified exactly by at least two of four independently written exact programs (big-integer cyclotomic arithmetic; finite-field specialization with CRT uniqueness proofs); the pipeline reproduces all nineteen of Sun’s published values. Part (i) survives all tests and remains open.
No-5-on-a-sphere record — papers/no5sphere-record/note.pdf
A 36-point subset of the 13×13×13 grid. For C(n), the largest subset of {1,…,n}^3 with no five points on a common sphere or plane, the strongest published lower bounds for 7 ≤ n ≤ 12 are due to AlphaEvolve, ending with C(12) ≥ 33. The paper exhibits an explicit centrally symmetric 36-point subset of {0,…,12}^3, proving C(13) ≥ 36. Verification is a finite exact-integer computation — all 376,992 lifted 5×5 determinants are nonzero — reproduced by a 21-line program printed in full and carried out by three independently written checkers validated by mutation testing.
Graffiti 143 & 154 — papers/graffiti-143-154/note.pdf
Counterexamples to two conjectures of Graffiti on graph eigenvalues. Two spectral conjectures from Fajtlowicz’s Graffiti program, both of which survived the 1990–91 computational attack of Brewster–Dinneen–Faber and a 2025 eight-algorithm search, are refuted. Conjecture 143 fails on dumbbell graphs (smallest certified counterexample: 39 vertices under both average- distance conventions), with the two sides’ ratio tending to 2. Conjecture 154 (standard-deviation reading) fails on lollipop graphs at 118/120 vertices, with unbounded ratio. All counterexamples carry exact rational certificates verified by two algorithmically independent routes per result.
Kurkov A000670 — papers/kurkov-a000670/note.pdf
A proof of Kurkov’s 2018 conjecture on the Fubini numbers. In OEIS A000670 (the Fubini numbers, counting ordered set partitions of an n-set) Mikhail Kurkov conjectured (Jul 2018) that a(n) = Sum_{k=0..2^(n-1)−1} A284005(k) for n > 0. The note proves it via a refined theorem: encoding k as an (n−1)-bit string b fixes a set of block minima M(b), and the number of ordered set partitions of [n] with that minima set is exactly the product ∏(1 + w_i) = A284005(k), so summing over all k recovers a(n). The refinement is verified exhaustively for all minima sets at n ≤ 8 (all 598,444 ordered set partitions, 0 mismatches) and the identity numerically to n = 20, with a mutation-tested checker.
Lean projects
Borsuk (the kernel-graded claim) — problems/p3-moonshot/borsuk/lean/.
Pinned toolchain leanprover/lean4:v4.30.0 and pinned mathlib manifest are
included; the multi-GB .lake/ build cache is not. To run the kernel check:
cd problems/p3-moonshot/borsuk/lean
lake update # resolves pinned deps; mathlib's hook fetches the build cache
lake build # expect "Build completed successfully"
lake env lean scripts/CheckAxioms.lean # expect only: propext, Classical.choice, Quot.sound
See problems/p3-moonshot/borsuk/lean/SETUP.md
for the full pinned-version table and troubleshooting. Once built,
verify_all.py picks the two Borsuk checks up automatically (33/33 PASS).
Elizalde–Luo (the second kernel-graded claim) —
problems/p3-moonshot/elizalde-luo/lean/. The full general-n theorem
elizalde_luo_1132_3312 is formalized and accepted by the Lean kernel — no
sorry, no admit, no native_decide; the axiom audit reports only the three
standard mathlib axioms. Build and re-check:
cd problems/p3-moonshot/elizalde-luo/lean
lake update # resolves pinned deps; mathlib's hook fetches the build cache
lake build # expect "Build completed successfully"
lake env lean scripts/AxiomCheck.lean # expect only: propext, Classical.choice, Quot.sound
See problems/p3-moonshot/elizalde-luo/lean/STATUS.md
for the full green-gate table (build, sorry/axiom grep, #print axioms, n ≤ 4
sanity layer).
Erdős #866 (kernel-graded headline theorems) —
problems/p4-erdos866/lean/. The exact-value theorem Erdos866.h4_eq_4
(h₄(n) = 4 for all n ≥ 331,777, both halves), 4 ≤ h₄(n) ≤ 1000, the first
strict g₄ < h₄ separation beyond k = 3, g₅ < 3,519,220, and the h₅
Fibonacci lower bound — all sorry-free on exactly the three standard axioms.
Note it pins upstream’s toolchain (leanprover/lean4:v4.28.0, mathlib
8f9d9cff) and vendors van Doorn’s public formalization byte-identical; see
problems/p4-erdos866/lean/SETUP.md
and the audit scripts scripts/AuditC4P1.lean / scripts/AuditC4Synth.lean.
Union-closed sets / Frankl constant —
problems/p6-moonshot/uc-frankl/lean/. A kernel-checked reduction proving
franklWithConstant_psi: the union-closed-sets constant ψ = (3 − √5)/2 is a
valid Frankl frequency bound (every finite union-closed family with a nonempty
member has an element contained in at least a ψ-fraction of its sets). Same
axiom discipline — lake env lean scripts/CheckAxioms.lean reports only
propext, Classical.choice, Quot.sound for every closed theorem, including
franklWithConstant_psi.
Layout
RESULTS.md,VALIDATION.md,verify_all.py— catalog, reading guide, master batterypapers/— six paper sources + PDFs, build notes, referee-round responses, recompute scriptsproblems/p0-iris/— IRIS 6.1 counterexamples: certificates, dual checkers (Python + Rust), mutation suiteproblems/p2-factory/kills/— one directory per refuted conjecture: frozen statement, certificate, checkers, mutation suites, writeups;problems/p2-factory/verify_kills.pyre-derives five kills from scratchproblems/p2-factory/attacks/sun-46/— clean-room verification side of the Sun 4.6 kill (exact subset-DP layer, exact cyclotomic layer, CRT uniqueness proof, original logs)problems/p1-records/no-5-on-a-sphere-grid/— the C(13) ≥ 36 certificate, three checker routes, hostile cross-model checker, provenance, construction-mining writeupproblems/p3-moonshot/borsuk/— Lean 4 project (kernel proof), paper source, statusproblems/p3-moonshot/elizalde-luo/— pinned definitions, ground-truth enumerators (Python/Rust/clean-room), audited proof drafts, spot-audit, and the kernel-checked Lean 4 proof (lean/, theoremelizalde_luo_1132_3312)problems/p4-erdos866/— the Erdős #866 release: frozen paper, complete Lean 4 development (Erdos866.h4_eq_4+ the other kernel claims), frozen verification reports with sha256s, checker scripts, and the SAT certificate-archive manifest (the 4.4 GB DRAT/LRAT archive itself lives on Zenodo —problems/p4-erdos866/RETRIEVAL.md)
Differences from the internal working tree
This is a curated snapshot. For full transparency, every adjustment made while staging it is listed here:
verify_all.py: the two Borsuk Lean checks now SKIP (with instructions) when.lake/packagesis absent, instead of silently starting an hours-long from-scratch mathlib build. No other logic changed. The Lean checks were executed and PASSed against exactly these staged sources with the build cache present before release.problems/p1-records/no-5-on-a-sphere-grid/verification/codex_hostile_no5sphere_check.py: the build machine’s hardcoded absolute certificate path was replaced by the equivalent relative path (the certificate is byte-identical, sha256333d36ec...as recorded in RESULTS.md §12).problems/p2-factory/attacks/sun-46/contains only the clean-room verification artifacts referenced by RESULTS.md §10 (checkers + original logs), not the attack-side working files.- Omitted: internal search/run directories (
runs/, per-n binary pools, Rusttarget/build intermediates — the needed prebuilt.exefiles are kept),__pycache__, the Elizalde–Luo internal audit work directories (except the bankedwork/triage_spotcheck.pyused byverify_all.py), and third-party copyrighted material (e.g. the Sun and AlphaEvolve paper files); RESULTS.md cites the public sources for all of these.
Methods and AI-use disclosure
The mathematical results in this repository were produced by Demonstrandum, a
verification-first multi-agent AI workflow built on Claude language models
(Anthropic), with adversarial cross-checks by a different model family (OpenAI
Codex/GPT) — the same disclosure carried in each paper. AI agents proposed
constructions, wrote checkers and proofs, and audited each other under a
protocol in which nothing is accepted on a model’s word: every accepted claim
is backed by a machine-verifiable artifact in this repository (certificate +
independent checkers, or a Lean proof accepted by the kernel), and any result
whose general-n statement rests on a written proof rather than a kernel proof
(e.g. the Kurkov A000670 note) is explicitly graded as such in RESULTS.md. Statements were
frozen verbatim from the authoritative sources before any attack. A human (the
author) directed the campaigns, audited the gates, and takes full
responsibility for the claims.
Citing
Cite the archived snapshot via the Zenodo DOI (machine-readable metadata in
CITATION.cff):
@misc{erlbacher2026demonstrandum,
author = {Erlbacher, John},
title = {Demonstrandum --- wave-1 verified artifacts},
year = {2026},
publisher = {Zenodo},
doi = {10.5281/zenodo.21269439},
url = {https://doi.org/10.5281/zenodo.21269439},
note = {Code and verification artifacts, github.com/demonstrandum-research/artifacts}
}
For an individual result, please also cite the corresponding paper in
papers/.
License
- Code (all scripts, checkers, Rust crates, Lean sources): MIT — see
LICENSE. - Text and data (writeups, papers, certificates, JSON artifacts): CC BY 4.0 — see
LICENSE-CC-BY-4.0.md.
Jared Zoneraich (@imjaredz): Proud to say that Devin has cracked three more unsolved problems today
- REFUTED: Graffiti Conjecture 154 (open for ~40 years)
- PROVED: Graffiti Conjectures 39 & 40 (~40 years)
- REFUTED: Brandt’s Regular Supergraph Problem from West’s open problems list (~20 years)
My
Similar Articles
A Rust-to-Lean verification pipeline with AI provers: An experience report
This paper presents an experience report on a verification pipeline that uses AI provers (Aristotle and Aleph) alongside symbolic extraction tools and formal cryptographic libraries to produce machine-checked correctness proofs for Rust cryptographic code in Lean 4, with case studies from the Ethereum Foundation's zkEVM project.
Discover and Prove: An Open-source Agentic Framework for Hard Mode Automated Theorem Proving in Lean 4
This paper introduces Discover and Prove (DAP), an open-source agentic framework for automated theorem proving in Lean 4 that tackles 'Hard Mode' problems where the answer must be discovered independently before formal proof construction. The work releases new Hard Mode benchmark variants and achieves state-of-the-art results while revealing a significant gap between LLM answer accuracy (>80%) and formal prover success (<10%).
We have proof automation now
The article discusses how LLMs can automate proof generation in dependently-typed languages like Lean and Rocq, making formal verification dramatically more practical by leveraging proof irrelevance and reducing the need for manual proof engineering.
@GregKamradt: "Code and math are taking off because they are easy to verify, the next frontier is domains that are hard to verify" Th…
Greg Kamradt proposes a 7-level spectrum of verification difficulty for AI, ranging from instantly verifiable domains like math and code to civilization-scale systems with slow, noisy feedback.
@omarsar0: NEW AI paper worth bookmarking. This is something I called early, and this paper confirms it: verification has emerged …
This paper from Stanford, NVIDIA, and UC Berkeley introduces LLM-as-a-Verifier, a training-free verification framework that uses continuous scoring from LLM logits to improve accuracy across coding, robotics, and medical domains, achieving state-of-the-art results on multiple benchmarks.