@dabit3: if you’re not following @imjaredz you should change that now

X AI KOLs Following Papers

Summary

This article presents Demonstrandum, a verification-first multi-agent AI mathematics pipeline that produces mechanically checkable artifacts, including refutations and proofs of conjectures with Lean 4 kernel verification.

if you’re not following @imjaredz you should change that now
Original Article
View Cached Full Text

Cached at: 07/24/26, 11:07 AM

if you’re not following @imjaredz you should change that now


demonstrandum-research/artifacts

Source: https://github.com/demonstrandum-research/artifacts

Demonstrandum — wave-1 verified artifacts

DOI Code: MIT Text & data: CC BY 4.0 Repo size

Demonstrandum is a verification-first multi-agent AI mathematics pipeline, directed and audited by John Erlbacher (Independent Researcher). Its house rule: no claim is accepted on an AI’s word — the unit of progress is an artifact on disk plus an independently written checker that accepts it, so every result below is mechanically checkable by you, with zero trust in any AI or in the author. This repository began as the complete 14-result wave-1 artifact bundle (11 refutations of published conjectures, two proofs of published conjectures, one numerical record), with six accompanying papers and a one-command master verification battery. It now also carries row 15, the Erdős problem #866 release (2026-07-08) — the eventual value of the Choi–Erdős–Szemerédi constant, h₄(n) = 4 for all n ≥ 331,777, kernel-verified in Lean 4, with improved g₅/h₅ bounds and a 298-cell dual-engine SAT-certified exact-value table — plus the later strong-majority five- and six-color kernel packages. Those later packages have their own rebuild instructions and are not silently included in the legacy master battery.

Results

Grades, defined precisely in RESULTS.md: kernel = the entire claim is a Lean 4 theorem accepted by the Lean kernel with only the three standard mathlib axioms; dual-checker = certificate accepted by ≥ 2 independently written checkers plus mutation testing; audit-panel = banked runnable checker plus adversarial clean-room audits across model families.

#resultgradepaperverify
1IRIS Conjecture 6.1 (“NuevaMirada”) — refuteddual-checkerpython verify_all.py --only iris
2Discrete Borsuk Conjecture 3 (arXiv:2508.20009) — disproved in Lean 4kernelpapers/borsuk/python verify_all.py --only borsuk
3Graffiti Conjecture 143 — refuteddual-checkerpapers/graffiti-143-154/python verify_all.py --only g143
4Graffiti Conjecture 154 (std-dev reading) — refuteddual-checkerpapers/graffiti-143-154/python verify_all.py --only g154
5TxGraffiti/Davila Conjecture 9 — refuteddual-checkerpython verify_all.py --only dc9
6Pandey parity conjecture — refuted (both directions)dual-checkerpython verify_all.py --only gp/
7Solubilizer Conjecture A.1 (arXiv:2412.16177) — refuteddual-checkerpython verify_all.py --only a1/
8Solubilizer Conjecture A.13 — refutedaudit-panelpython verify_all.py --only a13
9Solubilizer Conjecture A.16 — refutedaudit-panelpython verify_all.py --only a16
10Sun Conjecture 4.6 (arXiv:2108.07723) — refuteddual-checkerpapers/sun-46/python verify_all.py --only sun
11Koch–Narayan Conjecture 1 — refuteddual-checkerpython verify_all.py --only kn/
12C(13) ≥ 36 record (“no 5 on a sphere”)dual-checkerpapers/no5sphere-record/python verify_all.py --only no5
13Elizalde–Luo {1132, 3312} conjecture — proved in Lean 4kernelpapers/elizalde-luo/python verify_all.py --only eliz
14Kurkov’s 2018 A000670 conjecture (Fubini-number sum) — provedaudit-panelpapers/kurkov-a000670/python papers/kurkov-a000670/checker.py
15Erdős #866: h₄(n) = 4 for all n ≥ 331,777 (eventual CES constant); 4 ≤ h₄ ≤ 1000; g₅ ≤ 3,519,219; h₅ ≥ #{Fib ≤ n}+1; exact cells incl. g₅ = 4 on [15,23]kernel (headline theorems) + certificate ([E]: dual-engine SAT, DRAT/LRAT via cake_lpr, 298 cells)problems/p4-erdos866/paper/see problems/p4-erdos866/README.md

Each result also carries an explicit “what this does NOT show” caveat in RESULTS.md — claim calibration is part of the protocol.

Quickstart

Requirements: Python 3.10+ with numpy and sympy. Prebuilt Windows x64 Rust checker binaries are included; on other platforms they are rebuilt automatically when cargo is installed.

git clone https://github.com/demonstrandum-research/artifacts.git
cd artifacts
python verify_all.py            # default battery: 33 checks, ~5-15 min
python verify_all.py --full     # adds long redundant layers, ~25-30 min
python verify_all.py --strict   # SKIPs become failures (full zero-trust mode)
python verify_all.py --list     # list all checks; --only SUBSTR runs a subset

Expected final line without a local Lean build cache (the two Borsuk Lean checks SKIP with instructions rather than start a multi-hour mathlib build):

TOTAL: 31 PASS, 0 FAIL, 2 SKIP in ... s
WARNING: SKIPped checks mean the following results were NOT verified on this machine: Borsuk-C3

With the Lean build completed (next section): TOTAL: 33 PASS, 0 FAIL, 0 SKIP. A SKIP always means “not verified on this machine” — the summary says so loudly.

Papers

Six wave-one papers accompany the legacy headline results. Each directory contains the LaTeX source, the compiled PDF, build notes (BUILD.md), referee-round responses (RESPONSES.md), and recompute scripts.

Discrete Borsuk — papers/borsuk/note.pdf

Counterexamples to a conjectured characterization of cubes. Brose, De Loera, Lopez-Campos and Torres proved that the lattice Borsuk number of a bounded set S ⊂ Z^d is at most 2^d, and conjectured (arXiv:2508.20009, Conjecture 3) that it equals 2^d iff conv(S) is unimodularly equivalent to a cube. The four-point set {(0,0), (1,0), (0,1), (3,5)} has all pairwise differences primitive, so its lattice Borsuk number is 4 = 2^2, while its hull contains 7 lattice points and is therefore equivalent to no square. The disproof is formally verified: a ~1100-line Lean 4 development over mathlib proves betaZ SA = 4, latticeCount hullSA = 7, and conjecture3_false; the axiom audit reports only the three standard axioms. Two further counterexamples (exact arithmetic, not formalized) close the natural repair in dimensions 2 and 3.

Elizalde–Luo — papers/elizalde-luo/note.pdf

A proof of the Elizalde–Luo conjecture for nonnesting permutations avoiding 1132 and 3312. Elizalde and Luo (DMTCS 27:1, 2025) conjectured from data for n ≤ 8 that the number of nonnesting permutations of {1,1,…,n,n} avoiding both 1132 and 3312 is 3^n − 3·2^(n−1) + 1. The paper proves the conjecture with an elementary, self-contained argument (Dyck shape carrying a label permutation; avoidance forces prefix-interval labels; a two-coloring condition on crossing arcs), plus a second, bijective proof onto an explicit ternary language. Every lemma was verified mechanically far beyond the original data range, including an exhaustive check over all 57,657,600 nonnesting words at n = 8. The full general-n theorem is now formalized in Lean 4 and accepted by the Lean kernel (problems/p3-moonshot/elizalde-luo/lean/, theorem elizalde_luo_1132_3312; no sorry, no native_decide, axiom audit reports only the three standard mathlib axioms), so the result is graded kernel.

Sun 4.6 — papers/sun-46/note.pdf

The sign pattern of Sun’s trigonometric permanents. Zhi-Wei Sun (arXiv:2108.07723, Conjecture 4.6) conjectured sign patterns for two integer sequences arising from permanents of trigonometric matrices. Part (ii) — hence the conjecture as stated — fails at p = 29, the first prime beyond Sun’s published table: s_29 = 1,053,859 > 0 although 29 ≡ 5 (mod 12), and s’_29 = −4,806,838,304 < 0 although 29 ≡ 5 (mod 8). Every value is certified exactly by at least two of four independently written exact programs (big-integer cyclotomic arithmetic; finite-field specialization with CRT uniqueness proofs); the pipeline reproduces all nineteen of Sun’s published values. Part (i) survives all tests and remains open.

No-5-on-a-sphere record — papers/no5sphere-record/note.pdf

A 36-point subset of the 13×13×13 grid. For C(n), the largest subset of {1,…,n}^3 with no five points on a common sphere or plane, the strongest published lower bounds for 7 ≤ n ≤ 12 are due to AlphaEvolve, ending with C(12) ≥ 33. The paper exhibits an explicit centrally symmetric 36-point subset of {0,…,12}^3, proving C(13) ≥ 36. Verification is a finite exact-integer computation — all 376,992 lifted 5×5 determinants are nonzero — reproduced by a 21-line program printed in full and carried out by three independently written checkers validated by mutation testing.

Graffiti 143 & 154 — papers/graffiti-143-154/note.pdf

Counterexamples to two conjectures of Graffiti on graph eigenvalues. Two spectral conjectures from Fajtlowicz’s Graffiti program, both of which survived the 1990–91 computational attack of Brewster–Dinneen–Faber and a 2025 eight-algorithm search, are refuted. Conjecture 143 fails on dumbbell graphs (smallest certified counterexample: 39 vertices under both average- distance conventions), with the two sides’ ratio tending to 2. Conjecture 154 (standard-deviation reading) fails on lollipop graphs at 118/120 vertices, with unbounded ratio. All counterexamples carry exact rational certificates verified by two algorithmically independent routes per result.

Kurkov A000670 — papers/kurkov-a000670/note.pdf

A proof of Kurkov’s 2018 conjecture on the Fubini numbers. In OEIS A000670 (the Fubini numbers, counting ordered set partitions of an n-set) Mikhail Kurkov conjectured (Jul 2018) that a(n) = Sum_{k=0..2^(n-1)−1} A284005(k) for n > 0. The note proves it via a refined theorem: encoding k as an (n−1)-bit string b fixes a set of block minima M(b), and the number of ordered set partitions of [n] with that minima set is exactly the product ∏(1 + w_i) = A284005(k), so summing over all k recovers a(n). The refinement is verified exhaustively for all minima sets at n ≤ 8 (all 598,444 ordered set partitions, 0 mismatches) and the identity numerically to n = 20, with a mutation-tested checker.

Lean projects

Borsuk (the kernel-graded claim)problems/p3-moonshot/borsuk/lean/. Pinned toolchain leanprover/lean4:v4.30.0 and pinned mathlib manifest are included; the multi-GB .lake/ build cache is not. To run the kernel check:

cd problems/p3-moonshot/borsuk/lean
lake update     # resolves pinned deps; mathlib's hook fetches the build cache
lake build      # expect "Build completed successfully"
lake env lean scripts/CheckAxioms.lean   # expect only: propext, Classical.choice, Quot.sound

See problems/p3-moonshot/borsuk/lean/SETUP.md for the full pinned-version table and troubleshooting. Once built, verify_all.py picks the two Borsuk checks up automatically (33/33 PASS).

Elizalde–Luo (the second kernel-graded claim)problems/p3-moonshot/elizalde-luo/lean/. The full general-n theorem elizalde_luo_1132_3312 is formalized and accepted by the Lean kernel — no sorry, no admit, no native_decide; the axiom audit reports only the three standard mathlib axioms. Build and re-check:

cd problems/p3-moonshot/elizalde-luo/lean
lake update     # resolves pinned deps; mathlib's hook fetches the build cache
lake build      # expect "Build completed successfully"
lake env lean scripts/AxiomCheck.lean   # expect only: propext, Classical.choice, Quot.sound

See problems/p3-moonshot/elizalde-luo/lean/STATUS.md for the full green-gate table (build, sorry/axiom grep, #print axioms, n ≤ 4 sanity layer).

Erdős #866 (kernel-graded headline theorems)problems/p4-erdos866/lean/. The exact-value theorem Erdos866.h4_eq_4 (h₄(n) = 4 for all n ≥ 331,777, both halves), 4 ≤ h₄(n) ≤ 1000, the first strict g₄ < h₄ separation beyond k = 3, g₅ < 3,519,220, and the h₅ Fibonacci lower bound — all sorry-free on exactly the three standard axioms. Note it pins upstream’s toolchain (leanprover/lean4:v4.28.0, mathlib 8f9d9cff) and vendors van Doorn’s public formalization byte-identical; see problems/p4-erdos866/lean/SETUP.md and the audit scripts scripts/AuditC4P1.lean / scripts/AuditC4Synth.lean.

Union-closed sets / Frankl constantproblems/p6-moonshot/uc-frankl/lean/. A kernel-checked reduction proving franklWithConstant_psi: the union-closed-sets constant ψ = (3 − √5)/2 is a valid Frankl frequency bound (every finite union-closed family with a nonempty member has an element contained in at least a ψ-fraction of its sets). Same axiom discipline — lake env lean scripts/CheckAxioms.lean reports only propext, Classical.choice, Quot.sound for every closed theorem, including franklWithConstant_psi.

Layout

  • RESULTS.md, VALIDATION.md, verify_all.py — catalog, reading guide, master battery
  • papers/ — six paper sources + PDFs, build notes, referee-round responses, recompute scripts
  • problems/p0-iris/ — IRIS 6.1 counterexamples: certificates, dual checkers (Python + Rust), mutation suite
  • problems/p2-factory/kills/ — one directory per refuted conjecture: frozen statement, certificate, checkers, mutation suites, writeups; problems/p2-factory/verify_kills.py re-derives five kills from scratch
  • problems/p2-factory/attacks/sun-46/ — clean-room verification side of the Sun 4.6 kill (exact subset-DP layer, exact cyclotomic layer, CRT uniqueness proof, original logs)
  • problems/p1-records/no-5-on-a-sphere-grid/ — the C(13) ≥ 36 certificate, three checker routes, hostile cross-model checker, provenance, construction-mining writeup
  • problems/p3-moonshot/borsuk/ — Lean 4 project (kernel proof), paper source, status
  • problems/p3-moonshot/elizalde-luo/ — pinned definitions, ground-truth enumerators (Python/Rust/clean-room), audited proof drafts, spot-audit, and the kernel-checked Lean 4 proof (lean/, theorem elizalde_luo_1132_3312)
  • problems/p4-erdos866/ — the Erdős #866 release: frozen paper, complete Lean 4 development (Erdos866.h4_eq_4 + the other kernel claims), frozen verification reports with sha256s, checker scripts, and the SAT certificate-archive manifest (the 4.4 GB DRAT/LRAT archive itself lives on Zenodo — problems/p4-erdos866/RETRIEVAL.md)

Differences from the internal working tree

This is a curated snapshot. For full transparency, every adjustment made while staging it is listed here:

  1. verify_all.py: the two Borsuk Lean checks now SKIP (with instructions) when .lake/packages is absent, instead of silently starting an hours-long from-scratch mathlib build. No other logic changed. The Lean checks were executed and PASSed against exactly these staged sources with the build cache present before release.
  2. problems/p1-records/no-5-on-a-sphere-grid/verification/codex_hostile_no5sphere_check.py: the build machine’s hardcoded absolute certificate path was replaced by the equivalent relative path (the certificate is byte-identical, sha256 333d36ec... as recorded in RESULTS.md §12).
  3. problems/p2-factory/attacks/sun-46/ contains only the clean-room verification artifacts referenced by RESULTS.md §10 (checkers + original logs), not the attack-side working files.
  4. Omitted: internal search/run directories (runs/, per-n binary pools, Rust target/ build intermediates — the needed prebuilt .exe files are kept), __pycache__, the Elizalde–Luo internal audit work directories (except the banked work/triage_spotcheck.py used by verify_all.py), and third-party copyrighted material (e.g. the Sun and AlphaEvolve paper files); RESULTS.md cites the public sources for all of these.

Methods and AI-use disclosure

The mathematical results in this repository were produced by Demonstrandum, a verification-first multi-agent AI workflow built on Claude language models (Anthropic), with adversarial cross-checks by a different model family (OpenAI Codex/GPT) — the same disclosure carried in each paper. AI agents proposed constructions, wrote checkers and proofs, and audited each other under a protocol in which nothing is accepted on a model’s word: every accepted claim is backed by a machine-verifiable artifact in this repository (certificate + independent checkers, or a Lean proof accepted by the kernel), and any result whose general-n statement rests on a written proof rather than a kernel proof (e.g. the Kurkov A000670 note) is explicitly graded as such in RESULTS.md. Statements were frozen verbatim from the authoritative sources before any attack. A human (the author) directed the campaigns, audited the gates, and takes full responsibility for the claims.

Citing

Cite the archived snapshot via the Zenodo DOI (machine-readable metadata in CITATION.cff):

@misc{erlbacher2026demonstrandum,
  author       = {Erlbacher, John},
  title        = {Demonstrandum --- wave-1 verified artifacts},
  year         = {2026},
  publisher    = {Zenodo},
  doi          = {10.5281/zenodo.21269439},
  url          = {https://doi.org/10.5281/zenodo.21269439},
  note         = {Code and verification artifacts, github.com/demonstrandum-research/artifacts}
}

For an individual result, please also cite the corresponding paper in papers/.

License

  • Code (all scripts, checkers, Rust crates, Lean sources): MIT — see LICENSE.
  • Text and data (writeups, papers, certificates, JSON artifacts): CC BY 4.0 — see LICENSE-CC-BY-4.0.md.

Jared Zoneraich (@imjaredz): Proud to say that Devin has cracked three more unsolved problems today

  1. REFUTED: Graffiti Conjecture 154 (open for ~40 years)
  2. PROVED: Graffiti Conjectures 39 & 40 (~40 years)
  3. REFUTED: Brandt’s Regular Supergraph Problem from West’s open problems list (~20 years)

My

Similar Articles

A Rust-to-Lean verification pipeline with AI provers: An experience report

Lobsters Hottest

This paper presents an experience report on a verification pipeline that uses AI provers (Aristotle and Aleph) alongside symbolic extraction tools and formal cryptographic libraries to produce machine-checked correctness proofs for Rust cryptographic code in Lean 4, with case studies from the Ethereum Foundation's zkEVM project.

Discover and Prove: An Open-source Agentic Framework for Hard Mode Automated Theorem Proving in Lean 4

arXiv cs.CL

This paper introduces Discover and Prove (DAP), an open-source agentic framework for automated theorem proving in Lean 4 that tackles 'Hard Mode' problems where the answer must be discovered independently before formal proof construction. The work releases new Hard Mode benchmark variants and achieves state-of-the-art results while revealing a significant gap between LLM answer accuracy (>80%) and formal prover success (<10%).

We have proof automation now

Hacker News Top

The article discusses how LLMs can automate proof generation in dependently-typed languages like Lean and Rocq, making formal verification dramatically more practical by leveraging proof irrelevance and reducing the need for manual proof engineering.