Tag
PhoenixRepair is a multi-agent framework that systematically explores multiple candidate edit locations and performs iterative reflection and refinement on patch generation, achieving state-of-the-art results on SWE-bench-Verified with a 76.0% Pass@1 rate under MiniMax-M2.5 and a 7.8% relative improvement over SWE-agent under DeepSeek-V3.1.
This paper introduces the Precise Debugging Benchmark (PDB), a framework that evaluates LLMs on precise fault localization rather than just test pass rates. Results show frontier models like GPT-4.1-Codex and DeepSeek-V3.2-Thinking pass 76%+ of unit tests but achieve less than 45% edit precision, revealing a critical gap between code regeneration and true debugging.