@xdotli: mini-swe-agent is impressive. 100 lines, one bash tool, same prompt for every model tops on DeepSWE by @datacurve where…
Summary
mini-swe-agent is a minimal, open-source SWE-agent implementation that tops DeepSWE benchmarks with just 100 lines of code and a single bash tool. The team also open-sourced mini-swe-code for interactive use and mini-swe-acp for evaluation harness across benchmarks.
View Cached Full Text
Cached at: 06/12/26, 06:54 AM
mini-swe-agent is impressive.
100 lines, one bash tool, same prompt for every model
tops on DeepSWE by @datacurve where it matches or beats the vendors’ own harnesses.
So we open-sourced two things around it:
- mini-swe-code: play with it in @opencode’s TUI, one command: mini-opencode –attach
- mini-swe-acp: run it as an eval harness on any benchmark via @benchflow_ai (ACP)
hats off to @KLieret @jyangballin @ArpandeepKhatua and the SWE-agent team. repo in
and welcome our new MTS intern @bingran_bry who recently joined @benchflow_ai from quantum physics PhD program at Berkeley!
Similar Articles
DeepSWE-mini a 16 instance subset of DeepSWE that replicates the rankings of the leaderboard
Released a new dataset called DeepSWE-mini, a 16-instance subset of DeepSWE designed for efficient benchmarking of local AI models by replicating leaderboard rankings.
Someone did an audit on the new DeepSWE, the results aren't pretty
DeepSWE is a new benchmark for evaluating AI coding agents on real-world software engineering tasks from active open-source repositories, comprising 113 tasks across TypeScript, Go, Python, JavaScript, and Rust with isolated environments and program-based verifiers.
@_akhaliq: SWE-Bench ProMax Benchmarking Agents on Large-Scale Multilingual Code Refactoring paper: https://huggingface.co/papers/…
Introduces SWE-Bench ProMax, a multilingual code refactoring benchmark of 170 instances across 7 programming languages to evaluate AI coding agents. Frontier models achieve only 41.2% resolve rate, confirming it as a challenging and unsaturated benchmark.
SWE-Bench Pro V2 (9 minute read)
SWE-Bench Pro V2 is an updated benchmark for evaluating AI agents in software engineering, featuring 642 tasks across 11 repositories with improved evaluation protocols and contamination controls.
DeNovoSWE: Scaling Long-Horizon Environments for Generating Entire Repositories from Scratch
DeNovoSWE is a large-scale dataset for training code agents to generate entire software repositories from documentation, using a sandboxed agentic workflow and difficulty-aware filtering. Fine-tuning Qwen3-30B-A3B on it boosts performance on the BeyondSWE-Doc2Repo benchmark from 5.8% to 47.2%.