tsinghua-sigs-robot-lab/VeriLoop-E2 · Hugging Face

Source: https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2

VeriLoop E2

27B Post-Trained Model for Code, Mathematics, and Physics VeriLoop-Governed Recurrence (VGR) for Evidence-Convergent Reasoning

Built on Qwen3.8-27B · 262K native context · Apache License 2.0 Developed by Tsinghua SIGS Robot Lab · Libo Wang

Model·Technical Report·Evaluation Evidence·Riemann ζ Artifact·Black-Hole Artifact

https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2#overviewOverview

VeriLoop E2is an open 27B post-trained model built onQwen3.8-27B, targetingcode, mathematics, and physics. Its core reasoning discipline isVeriLoop-Governed Recurrence (VGR): candidate states are recursively proposed, externally checked, and retained only when the protected evidence state improves without regression.

The system separates generative intelligence from verification authority.VeriLoop E2is responsible for proposal generation, abstraction, diagnosis, repair hypotheses, and structured reasoning. TheVeriLoop Harnessgoverns evidence admission, deterministic checks, external verification, commit/rollback, stopping, and evidence-state persistence. The model therefore does not self-certify its own progress.

This release focuses on the model weights, public inference path, evaluation record, and public functional description of the Harness. The production Harness implementation itself isnot includedin this repository.

https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2#release-highlightsRelease highlights

• 27B open-weight post-trained modelfor code, mathematics, and physics, derived from Qwen3.8-27B.
• 262,144-token native context windowin the released tokenizer configuration.
• Strong release results across nine code-agent, mathematics, and science benchmarks, including76.2% SWE-bench Pro,88.8% Terminal-Bench 2.1,98.3% AIME 2026,93.9% GPQA Diamond, and89.6% Apex 2025.
• A reproducible scientific-reasoning program built around verifier-governed recurrence rather than unconstrained retry.
• Two public scientific demonstrations with released evidence artifacts: a strict finite-dimensionalRiemann ζ zero-proportion certificate at 67.350003708785593%, andAsymptotic Graviton Tomography, which establishes an exact-and-quantitative completeness framework for free asymptotic radiative graviton data.
• OpenAI-compatible serving throughvLLM 0.17.0with a validated 131,072-token serving configuration.

https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2#model-summaryModel Summary

PropertyVeriLoop E2Model familyVeriLoop E2Base modelQwen3.8-27BParameter class27BHF architecture classQwen3\_5ForConditionalGenerationTraining stagePost-TrainingPrimary domainsCode, software engineering, mathematics, physicsPublic post-training corpus accounting1,841,831 recordsNative context length262,144 tokensValidated vLLM serving length131,072 tokensTokenizer classQwen2TokenizerWeight formatsafetensorsLanguagesEnglish, ChineseRecommended serving enginevLLM 0.17.0Model-weight licenseApache License 2.0Release year2026 The post-training mix spans repository-level software engineering, terminal and tool use, mathematical reasoning, scientific reasoning, verifier-sensitive repair, and recurrence-oriented training. Exact data construction, filtering, and training methodology are documented in the technical report rather than duplicated here.

https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2#benchmark-resultsBenchmark Results

The README reports thefrozen release scoresfor VeriLoop E2. Agentic benchmarks use the E2 checkpoint inside the frozen evaluation workflow, including the internal VeriLoop Harness where required by the task, benchmark-native tools, and the benchmark’s official or designated evaluator. Exact per-benchmark protocols, task-level outputs, evaluator receipts, and integrity metadata are published separately in theEvaluation Evidencepackage.

**Attribution boundary.**The reported results characterize the evaluated E2 system configuration. They should not be interpreted as evidence that an untouched Qwen3.8-27B base checkpoint, or the E2 checkpoint outside the evaluated runtime, reproduces the same numbers.

**Figure 1.**VeriLoop E2 release snapshot across nine public benchmarks. Higher is better. Provider colors are fixed across panels; exact public model variants are shown in the comparison tables below. Full protocol and source provenance:Evaluation Evidence.

https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2#code-and-agentic-benchmarksCode and agentic benchmarks

BenchmarkVeriLoop E2OpenAIAnthropicKimiGLMQwenDeepSeek**SWE-bench Pro****76.2GPT-5.6 Sol 64.6Claude Fable 5.1 81.2—GLM-5.2 Max 62.1Qwen3.8-Max 67.7DeepSeek V4 Pro Max 55.4Terminal-Bench 2.1****88.8GPT-5.6 Sol 88.8—Kimi K3 88.3GLM-5.3 88.2Qwen3.8-Max 86.6DeepSeek V4 Pro 87.9DeepSWE v1.1****64.6GPT-5.6 Sol 72.7Claude Fable 5 69.7Kimi K3 67.5GLM-5.3 66.9—DeepSeek V4 Pro 62.7Terminal-Bench 3.0****29.7GPT-5.6 Sol 34.6Claude Fable 5 33.7Kimi K3 17.4GLM-5.3 28.3——Terminal-Bench 4.037.9GPT-6 Astra 59.6Claude Fable 5.1 55.1—GLM-5.3 41.8——SWE-Marathon v1.145.0**GPT-5.6 Sol 42.5Claude Opus 4.8 48.8Kimi K3 48.1GLM-5.3 42.5——

https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2#mathematics-and-science-benchmarksMathematics and science benchmarks

BenchmarkVeriLoop E2OpenAIAnthropicKimiGLMDeepSeekGemini**AIME 2026****98.3GPT-5.5 100.0Claude Opus 4.8 100.0Kimi K3 97.0—DeepSeek V4 Pro 97.0Gemini 3.1 Pro 98.0GPQA Diamond****93.9GPT-5.6 Sol 94.1Claude Fable 5 92.6Kimi K3 93.5GLM-5.2 Max 91.2——Apex 202589.6**GPT-5.5 80.0Claude Opus 4.8 81.0Kimi K3 66.0—DeepSeek V4 Pro 28.0Gemini 3.1 Pro 61.0 A dash means that the release figure does not include a public comparison point for that provider on that benchmark. Each linked VeriLoop E2 score above resolves directly to its benchmark-specific public evidence directory or release source. External reference values mirror the frozen comparison set used in Figure 1; harness notes and protocol caveats are retained in the evaluation ledger rather than duplicated here.**Seven results currently map to Hugging Face Native Benchmark leaderboards:**AIME 2026, DeepSWE v1.1, GPQA Diamond, SWE-bench Pro, Terminal-Bench 2.1, Terminal-Bench 3.0, and Terminal-Bench 4.0.Apex 2025 (89.6)andSWE-Marathon v1.1 (45.0)are presented here aslaboratory self-published release resultswith public source links. Apex 2025 is retained as a structured model result with public evidence, butMathArena/apex\_2025is not currently a Hugging Face Native Benchmark leaderboard; SWE-Marathon v1.1 now has public task-level evidence in the Evaluation Evidence repository, while a stable Hugging Face Native Benchmark registration/task identifier is not currently available.

https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2#evaluation-evidenceEvaluation evidence

The public evidence package is intended to make the benchmark record inspectable rather than merely declarative. Where available, each task record binds:

task identity
    ↓
model / system output
    ↓
benchmark-native execution or evaluator record
    ↓
score / pass-fail decision
    ↓
integrity metadata and provenance

Evidence repository:https://huggingface.co/datasets/tsinghua-sigs-robot-lab/VeriLoop-E2-Evaluation-Evidence

The model repository publisheseight structured evaluation descriptorsunder/\.eval\_results/. Seven of them currently map to Hugging Face Native Benchmark leaderboards; the Apex 2025 descriptor is retained for structured reporting and provenance, but does not currently produce a Hugging Face leaderboard rank. SWE-Marathon v1.1 is published with task-level evidence in the Evaluation Evidence repository as a laboratory self-published release result and is not included in/\.eval\_results/because a stable Hugging Face Native Benchmark registration/task identifier is not currently available.

https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2#veriloop-harnessVeriLoop Harness

VeriLoop is not designed around the idea that a model should announce its own improvement. The Harness treats model output as acandidate statethat must earn admission through external evidence.

The current public abstraction isVeriLoop-Governed Recurrence (VGR):

Current request
    ↓
Contract compilation
    ↓
VeriLoop E2 proposes a candidate
    ↓
External / deterministic verification
    ↓
Protected evidence state comparison
    ├── no protected regression + at least one strict improvement → COMMIT
    ├── otherwise                                             → ROLLBACK
    └── zero-rank certificate                                → STOP
    ↓
Verified evidence becomes the next recurrence state

The key boundary is deliberate:

• **Model authority:**propose, reason, abstract, diagnose, synthesize, repair.
• **Harness authority:**admit evidence, execute deterministic checks, verify, commit, roll back, stop, and persist verified state.
• **Benchmark / domain authority:**define task truth through native evaluators, tests, formal checks, numerical certificates, or other domain-specific validators.

This architecture is intended to preserve capability while preventing self-reported success from becoming system state. In software engineering, that means tests and execution receipts dominate plausible-looking patches. In mathematics and physics, it means a retained derivation must survive the relevant symbolic, numerical, or formal checks before it is promoted.

The production implementation contains private orchestration, routing, thresholds, prompt compilation, evidence-state machinery, repair arbitration, and deployment controls. Those implementation details are not part of this open model release. The README exposes thefunctional contract, not the proprietary runtime.

https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2#public-14-rule-engineering-contractPublic 14-Rule Engineering Contract

The public Golden Rules are the model-visible execution discipline used to keep long-horizon work bounded, testable, and auditable.

#RulePublic meaning1Current Request SupremacyThe current request and exact output contract override stale memory, templates, and unrelated context.2Evidence Before EscalationSearch, tools, reverse analysis, or repair are triggered by concrete missing evidence or observed failure, not instinct.3Read Before RewriteInspect the relevant entry points, interfaces, tests, conventions, and failure signals before editing.4Minimal Sufficient ImplementationProduce the smallest complete artifact that satisfies the task and preserves required interfaces.5Surgical Repair, Not Blind RegenerationRepair the broken invariant; broaden the rewrite only when evidence shows local repair is insufficient.6Intent Tests Beat Cosmetic TestsSyntax and formatting matter, but functional intent is the decisive acceptance criterion.7Fail Loud, Never Fake SuccessUnknowns, skipped checks, degraded states, and failures remain explicit; unexecuted validation is never reported as success.8Deterministic Logic Belongs in CodeParsing, scoring, structural checks, transformations, and reproducible validation should be deterministic whenever possible.9Budget Is a First-Class ContractToken, tool, time, and compute budgets are part of the task contract rather than afterthoughts.10Tool Use Must Be Typed and AccountableEvery tool action has a trigger, expected output, and defined downstream consumer.11Checkpoint Long TasksPersist useful candidate state, validation receipts, repair records, and progress across long-running work.12Follow Local ConventionsRespect repository, benchmark, filename, API, language, and artifact conventions unless the request explicitly changes them.13One Final Deliverable, Full Evidence BundleSelect one deliverable while retaining the evidence needed to explain and reproduce why it was selected.14Separate Core Discipline from Domain OverlaysDomain- or benchmark-specific rules apply only when relevant and cannot override the current request.

https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2#scientific-demonstrationsScientific Demonstrations

The scientific demonstrations are not presented as isolated chat transcripts. They are examples of how the E2 model and the internal Harness can divide a difficult research problem into candidate derivations, falsifiable subclaims, executable checks, retained evidence, and explicit claim boundaries.

https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2#riemann-%CE%B6-67350003708785593-strict-finite-dimensional-certificateRiemann ζ: 67.350003708785593% strict finite-dimensional certificate

The released Riemann artifact reports a frozen assembly value of

[ \kappa = 67.350003708785593%. ]

The current strict package closes3/3 local inequalities, resolves327/327 difficult wells, executes190,375,830 strict branch-and-bound nodes, and passes the finalexact rational assemblycheck.

**Established result.**Within the released analytic setup and its explicitly imported assumptions, the artifact establishes a strict finite-dimensional computer-assisted certificate at the stated zero-proportion value. The claim is therefore the certificate itself, together with its reproducible derivation, computation, and assembly evidence.

Boundary and current work.This result isnot a proof of the Riemann Hypothesis, and it isnot yet an end-to-end Lean/nanoda kernel proof of the complete upstream analytic chain. The remaining work is being directed at that exact boundary: formalizing the imported analytic normalization steps, binding them to the finite-dimensional certificate, and closing a complete kernel-replay path from the upstream analytic assumptions through the final assembly. Until that bridge is closed, the public claim remains the strict finite-dimensional certificate under the stated framework rather than a formal proof of the full analytic chain.

Artifact:https://github.com/brucewang123456789/GeniusTrail/tree/VeriLoop-E2/riemann-hypothesis

https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2#black-hole-information-problem-asymptotic-graviton-tomographyBlack-hole information problem: Asymptotic Graviton Tomography

The second scientific demonstration isAsymptotic Graviton Tomography, a verifier-governed theoretical-physics research artifact focused on information reconstruction fromfree asymptotic radiative graviton data at future null infinity.

Established result.The released artifact establishes an exact-and-quantitative tomography framework with nine stated results, T1–T9. The exact layer includes theSector Connectivity Theorem, the hard-Fock commutant [ \mathcal{A}_F’ = W^*(\hat N), ] a linear-connector completion theorem, and a two-branch classification of the infrared-memory layer. The quantitative layer identifies the algebraic connectivity (\lambda_2) of the coherence-transfer Laplacian as the modulus of informational completeness; in the stated two-mode (su(2)) reduction it obtains [ \operatorname{spec}(L)=\lambda^2 k(k+1), \qquad \lambda_2 = 2\lambda^2, ] with the gap independent of graviton number (N) and extremal operator (N_R). The repository contains the analytic derivations, a derivation walkthrough, theorem-status metadata, the reference computation transcript, and six executable numerical/structural certificates; the released reference suite reports6/6 PASS.

Boundary and current work.This artifactdoes not solve the black-hole information paradox. It does not yet provide interacting or evaporating black-hole dynamics, initial-to-out faithfulness, a Hawking-radiation derivation, or a proof of evaporation unitarity. Those missing dynamical layers define the active research frontier rather than being hidden behind the present result. Current work is focused on deriving the infrared exponent from first principles for specified dressing geometries, extending the spectral-gap analysis to genuinely multi-mode connectors, replacing the discrete memory label with the physical direct-integral continuum formulation, extending the Laplacian framework beyond exactly block-diagonal base algebras, and developing a dynamical completeness modulus capable of connecting initial data to outgoing radiation. Until that bridge is closed, the claim remains deliberately restricted to the free-asymptotic radiative setting.

Artifact:https://github.com/brucewang123456789/GeniusTrail/tree/VeriLoop-E2/black%20hole%20information%20paradox

The scientific artifacts are released separately from the model weights and retain their own artifact-specific terms. The Riemann ζ artifact follows its own research-use terms;Asymptotic Graviton Tomography is released under CC BY 4.0as stated in its repository. Neither artifact should be assumed to inherit the Apache-2.0 grant that applies to the model weights and public inference utilities.

https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2#inferenceInference

https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2#recommended-environmentRecommended environment

The following stack is the validated reference environment for the public serving path:

ComponentVersion / settingPython3.12.xvLLM0.17.0PyTorch2.10.0 + CUDA 12.9 buildCUDA runtime12.9Transformers4.57.6Triton3.6.0Dtypebfloat16Validated serving context131,072 tokens The released tokenizer advertises a native maximum length of262,144 tokens. The 131,072-token value above is thevalidated public serving configuration, not a redefinition of the model’s native context length. Longer serving windows require appropriate accelerator memory and KV-cache planning.

https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2#vllm-servervLLM server

Use the tokenizer and chat template shipped with the model repository.

python -m pip install "vllm==0.17.0"

MODEL="<MODEL_PATH_OR_HF_ID>"

vllm serve "${MODEL}" \
  --served-model-name veriloop-e2 \
  --dtype bfloat16 \
  --model-impl vllm \
  --language-model-only \
  --max-model-len 131072 \
  --max-num-seqs 16 \
  --gpu-memory-utilization 0.92 \
  --generation-config vllm \
  --disable-uvicorn-access-log \
  --host 127.0.0.1 \
  --port 8001

https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2#openai-compatible-requestOpenAI-compatible request

curl http://127.0.0.1:8001/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model": "veriloop-e2",
    "messages": [
      {"role": "user", "content": "Reply exactly: 8001_OK"}
    ],
    "temperature": 0,
    "max_tokens": 16,
    "stream": false
  }'

A validated smoke test returns:

8001_OK

https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2#python-clientPython client

from openai import OpenAI

client = OpenAI(
    base_url="http://127.0.0.1:8001/v1",
    api_key="EMPTY",
)

response = client.chat.completions.create(
    model="veriloop-e2",
    messages=[
        {"role": "user", "content": "Explain why rollback matters in verifier-governed reasoning."}
    ],
    temperature=0.2,
    max_tokens=1024,
)

print(response.choices[0].message.content)

https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2#protocol-noteProtocol note

For tool use or long multi-turn reasoning, treat the repository-shipped tokenizer and chat template as part of the model protocol. Replacing role delimiters, tool-call syntax, stop semantics, or reasoning-history behavior can change observed system behavior even when the weights are unchanged.

https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2#release-boundary-and-artifact-termsRelease Boundary and Artifact Terms

Different artifacts intentionally carry different permissions. Do not infer that the model-weight license automatically applies to separately published scientific artifacts or private system components.

ArtifactPublic statusTermsVeriLoop E2 model weights, tokenizer, configurationPublicApache License 2.0****Public vLLM launch / inference utilitiesPublicApache License 2.0****Benchmark results and evaluation evidencePublic / separately publishedReuse permitted with attribution toVeriLoop E2 / Libo Wang; upstream benchmark assets retain their original termsRiemann ζ scientific artifactPublic / separately publishedResearch-only, non-commercial; see artifact-specific termsAsymptotic Graviton Tomography artifactPublic / separately publishedCC BY 4.0; see artifact-specific termsProduction VeriLoop Harness implementationNot includedNot licensed by this release The open model license does not disclose or license unpublished Harness orchestration, prompt compilation, verifier routing, private evidence-state schemas, repair arbitration, deployment infrastructure, private training data, or other non-distributed internal systems.

https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2#limitationsLimitations

• VeriLoop E2 is a post-trained model component; the complete production VeriLoop Harness is not part of this release.
• Reported system benchmarks may depend on benchmark-native tools, sandbox behavior, evaluator versions, and the frozen Harness configuration described in the evidence package.
• The model can still produce incorrect code, invalid proofs, physically unsupported arguments, insecure commands, or incomplete analyses.
• A plausible-looking derivation is not equivalent to a verified result; domain-native verification remains necessary.
• Long-context performance depends on serving configuration, accelerator memory, KV-cache budget, and workload shape.
• Community-modified templates, stop rules, parsers, or client logic can materially change observed tool-use and reasoning behavior.
• Scientific demonstration artifacts have explicit scope boundaries and should not be generalized beyond the claims actually certified by their released evidence.

https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2#linksLinks

https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2#citationCitation

If you use VeriLoop E2 in research, please cite the model release and the relevant evaluation or scientific artifact separately.

@misc{wang2026veriloope2,
  title        = {VeriLoop E2: A 27B Post-Trained Model for Code, Mathematics, and Scientific Reasoning},
  author       = {Wang, Libo},
  year         = {2026},
  note         = {Tsinghua Shenzhen International Graduate School (SIGS)},
  howpublished = {Open model release},
  url          = {https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2}
}

For benchmark figures or evaluation records, attribution should identifyVeriLoop E2 / Libo Wangand link to the public evaluation evidence package:https://huggingface.co/datasets/tsinghua-sigs-robot-lab/VeriLoop-E2-Evaluation-Evidence.

https://huggingface.co/tsinghua-sigs-robot-lab/VeriLoop-E2#acknowledgementsAcknowledgements

VeriLoop E2 builds onQwen3.8-27Band the broader open-source model-serving, evaluation, and scientific-computing ecosystem. We thank the communities behind Qwen, Transformers, vLLM, Safetensors, software-engineering benchmarks, mathematical evaluation suites, and reproducible scientific computation.

The model, benchmark evidence, and scientific artifacts are published with explicit boundaries so that capability claims can be inspected at the level at which they were actually produced and verified.