Dockerless: Environment-Free Program Verifier for Coding Agents
Summary
This paper introduces Dockerless, an environment-free agentic patch verifier that evaluates code patches without execution, outperforming existing open-source verifiers and enabling efficient post-training for coding agents.
View Cached Full Text
Cached at: 07/01/26, 03:40 AM
Paper page - Dockerless: Environment-Free Program Verifier for Coding Agents
Source: https://huggingface.co/papers/2606.28436 Published on Jun 26
·
Submitted byhttps://huggingface.co/YerbaPage
Yulingon Jul 1
#1 Paper of the day Authors:
,
,
,
,
,
,
,
,
,
,
,
Abstract
A Dockerless environment-free agentic patch verifier improves code patch evaluation accuracy and enables effective post-training without execution-based verification costs.
Program verifiersplay a central role in training coding agents, including selecting trajectories forsupervised fine-tuning(SFT) andproviding rewards forreinforcement learning(RL). Standard execution-based verification requires running unit tests inside per-repository environments such as Docker images, incurring substantial environment setup costs. WeproposeDockerless, anenvironment-freeagentic patch verifierthat evaluates generated code patches without executing them. Rather than simply matching candidate patches to references,Dockerlessjudges patch correctness using evidence gathered through agenticrepository exploration. On a verifier evaluation benchmark,Dockerlessoutperforms the strongest open-source verifier by 14.3 AUC points. UsingDockerlessas both the SFT trajectory filter and the RL reward enables a fullyenvironment-freepost-training pipeline. The resulting model reaches 62.0%, 50.0%, and 35.2% resolve rate onSWE-bench Verified,Multilingual, andPro, respectively. It surpasses the Qwen3.5-9B baseline by 2.4, 8.7, and 2.9 points, matching environment-based post-training.
View arXiv pageView PDFAdd to collection
Get this paper in your agent:
hf papers read 2606\.28436
Don’t have the latest CLI?curl \-LsSf https://hf\.co/cli/install\.sh \| bash
Models citing this paper0
No model linking this paper
Cite arxiv.org/abs/2606.28436 in a model README.md to link it from this page.
Datasets citing this paper0
No dataset linking this paper
Cite arxiv.org/abs/2606.28436 in a dataset README.md to link it from this page.
Spaces citing this paper0
No Space linking this paper
Cite arxiv.org/abs/2606.28436 in a Space README.md to link it from this page.
Collections including this paper0
No Collection including this paper
Add this paper to acollectionto link it from this page.
Similar Articles
@YerbaShi: Can we RL coding agents without environments? The answer is yes! In Dockerless, we replace environment-based test execu…
Dockerless is a new method that enables reinforcement learning for coding agents without requiring environment setup by using an agentic verifier to explore the repository and score patches as rewards.
@adithya_s_k: https://x.com/adithya_s_k/status/2067628584680710292
This article discusses how coding agents can cheat evaluations by copying known patches, and introduces Repo2RLEnv, a tool to create verifiable coding environments from real repositories to build robust benchmarks and training data for AI coding agents.
OpenComputer: Verifiable Software Worlds for Computer-Use Agents
OpenComputer presents a framework for creating verifiable software environments for computer-use agents, integrating state verifiers, self-improving verification layers, task synthesis, and evaluation systems across 33 desktop applications. Experiments show its verifiers align better with human judgment than LLM-as-judge, and frontier agents struggle with end-to-end completion.
run coding agents in localised airlocked microVMs
code-airlock is an open-source tool that runs AI coding agents inside disposable microVMs to avoid granting them direct access to the host filesystem. It clones the repo into a sandbox so agents can work freely, and after completion, users review and pull back only desired changes.
Outside verification has been the missing piece in my coding-agent runs
The author notes that external verification is a crucial missing component in effectively using AI coding agents.