Dockerless: Environment-Free Program Verifier for Coding Agents

Hugging Face Daily Papers Papers

Summary

This paper introduces Dockerless, an environment-free agentic patch verifier that evaluates code patches without execution, outperforming existing open-source verifiers and enabling efficient post-training for coding agents.

Program verifiers play a central role in training coding agents, including selecting trajectories for supervised fine-tuning (SFT) and providing rewards for reinforcement learning (RL). Standard execution-based verification requires running unit tests inside per-repository environments such as Docker images, incurring substantial environment setup costs. We propose Dockerless, an environment-free agentic patch verifier that evaluates generated code patches without executing them. Rather than simply matching candidate patches to references, Dockerless judges patch correctness using evidence gathered through agentic repository exploration. On a verifier evaluation benchmark, Dockerless outperforms the strongest open-source verifier by 14.3 AUC points. Using Dockerless as both the SFT trajectory filter and the RL reward enables a fully environment-free post-training pipeline. The resulting model reaches 62.0%, 50.0%, and 35.2% resolve rate on SWE-bench Verified, Multilingual, and Pro, respectively. It surpasses the Qwen3.5-9B baseline by 2.4, 8.7, and 2.9 points, matching environment-based post-training.
Original Article
View Cached Full Text

Cached at: 07/01/26, 03:40 AM

Paper page - Dockerless: Environment-Free Program Verifier for Coding Agents

Source: https://huggingface.co/papers/2606.28436 Published on Jun 26

·

Submitted byhttps://huggingface.co/YerbaPage

Yulingon Jul 1

#1 Paper of the day Authors:

,

,

,

,

,

,

,

,

,

,

,

Abstract

A Dockerless environment-free agentic patch verifier improves code patch evaluation accuracy and enables effective post-training without execution-based verification costs.

Program verifiersplay a central role in training coding agents, including selecting trajectories forsupervised fine-tuning(SFT) andproviding rewards forreinforcement learning(RL). Standard execution-based verification requires running unit tests inside per-repository environments such as Docker images, incurring substantial environment setup costs. WeproposeDockerless, anenvironment-freeagentic patch verifierthat evaluates generated code patches without executing them. Rather than simply matching candidate patches to references,Dockerlessjudges patch correctness using evidence gathered through agenticrepository exploration. On a verifier evaluation benchmark,Dockerlessoutperforms the strongest open-source verifier by 14.3 AUC points. UsingDockerlessas both the SFT trajectory filter and the RL reward enables a fullyenvironment-freepost-training pipeline. The resulting model reaches 62.0%, 50.0%, and 35.2% resolve rate onSWE-bench Verified,Multilingual, andPro, respectively. It surpasses the Qwen3.5-9B baseline by 2.4, 8.7, and 2.9 points, matching environment-based post-training.

View arXiv pageView PDFAdd to collection

Get this paper in your agent:

hf papers read 2606\.28436

Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash

Models citing this paper0

No model linking this paper

Cite arxiv.org/abs/2606.28436 in a model README.md to link it from this page.

Datasets citing this paper0

No dataset linking this paper

Cite arxiv.org/abs/2606.28436 in a dataset README.md to link it from this page.

Spaces citing this paper0

No Space linking this paper

Cite arxiv.org/abs/2606.28436 in a Space README.md to link it from this page.

Collections including this paper0

No Collection including this paper

Add this paper to acollectionto link it from this page.

Similar Articles

@adithya_s_k: https://x.com/adithya_s_k/status/2067628584680710292

X AI KOLs Timeline

This article discusses how coding agents can cheat evaluations by copying known patches, and introduces Repo2RLEnv, a tool to create verifiable coding environments from real repositories to build robust benchmarks and training data for AI coding agents.

OpenComputer: Verifiable Software Worlds for Computer-Use Agents

Hugging Face Daily Papers

OpenComputer presents a framework for creating verifiable software environments for computer-use agents, integrating state verifiers, self-improving verification layers, task synthesis, and evaluation systems across 33 desktop applications. Experiments show its verifiers align better with human judgment than LLM-as-judge, and frontier agents struggle with end-to-end completion.

run coding agents in localised airlocked microVMs

Reddit r/AI_Agents

code-airlock is an open-source tool that runs AI coding agents inside disposable microVMs to avoid granting them direct access to the host filesystem. It clones the repo into a sandbox so agents can work freely, and after completion, users review and pull back only desired changes.