Try Benzi- A coding agwnt that _queries_ your codebase instead of reading it

Reddit r/AI_Agents Tools

Summary

Benzi is a coding agent that queries codebases to understand and write code, achieving 77.4% on SWE-bench Verified for under $30, and is model agnostic.

Benzi is a compiler + runtime tracer + harness and Al agent built to understand code from ground up. Challenging traditional RAG and embedding space approaches, Benzi aims to write code as cleanly as it understands it. 77.4% SWE-bench Verified (#4 on the leaderboard) for less than $30. (using deepseekv4flash. Benzi is model agnostic) Also included in the benchmarks page is proof for mechanism that makes this possible. Any feedback is greatly appriciated!
Original Article

Similar Articles

SWE-Explore: Benchmarking How Coding Agents Explore Repositories

Hugging Face Daily Papers

SWE-Explore introduces a benchmark for evaluating coding agents' repository exploration capabilities, requiring ranked lists of relevant code regions within line budgets. Experiments show agentic exploration outperforms traditional retrieval, and line-level coverage remains a key differentiator.