Tag
This paper evaluates three approaches (pure chain-of-thought reasoning, single-shot code execution, and iterative code execution) on 1,000 GSM-Symbolic problems using Claude Haiku 4.5, finding that chain-of-thought is the most robust to perturbation, while code execution does not improve reasoning robustness on grade-school math problems.
HOL Guard is an open-source security tool that provides dangerous command identification, interception, and auditing for development agents such as Codex, Claude Code, etc. It supports multiple protection levels and a local approval center to prevent risks like accidental deletion or modification.
Discusses whether to isolate the tool or the agent when running agents that execute arbitrary code, concluding that isolating the agent is superior due to zero secrets and a control-plane proxy.
Introduces ast-guard, an open-source AST-based security tool that prevents malicious code execution from LLM-generated Python strings by parsing them into an abstract syntax tree and applying node-level whitelisting and context-aware safety checks.
Built a GitHub Issue Triage Agent using a single curl to the Gemini API that clones repos, fetches issues, classifies them, and executes reproducer code to confirm bugs, without any orchestration framework.
Harrison Chase announces a lightweight code execution environment called code interpreter that enables RLMs and programmatic tool calling without needing a full sandbox, with more use cases to be detailed.
Deep Agents introduces interpreters: small embedded runtimes that allow agents to write and execute code inside the agent loop, enabling multi-step logic and intermediate state management without full sandbox overhead.
Phil Schmid announces Managed Agents in the Gemini API, enabling one-call agents with code execution, web browsing, and file management in isolated sandboxes, powered by Gemini 3.5 Flash.
This paper introduces ThinC (Thinking in Code), a framework where language models use code blocks exclusively for reasoning after a brief natural language planning step, outperforming existing tool-integrated reasoning baselines on math benchmarks.
Anthropic's 'Code Mode' reframes the MCP vs CLI debate by having AI agents write code to call tools via a runtime rather than loading full schemas into context, drastically reducing token usage. This approach combines MCP's typed contracts with lazy loading, proving the protocol is evolving rather than dying.
The article discusses a shift in AI agent tool usage from the 'MCP vs CLI' debate to 'Code Mode,' where agents write code to dynamically import tools, significantly reducing context window usage. It highlights Anthropic's approach and Cloudflare's implementation, demonstrating a 98.7% reduction in token consumption for specific tasks.
OpenDevin is an open-source platform for developing AI agents that can write code, use command lines, and browse the web to interact with the environment. It supports multiple agents, sandboxed code execution, and evaluation benchmarks like SWE-Bench.
This article from Anthropic explores how integrating code execution with the Model Context Protocol (MCP) can improve the efficiency of AI agents. It addresses challenges like token overload from tool definitions and intermediate results, proposing code execution as a solution to reduce latency and costs.