Tag
User @mylifcc shares their evaluation of Fable 5 and GPT-5.6 Sol on complex coding tasks, believing that Fable 5 has high accuracy but high cost, proposes a hybrid workflow model, sparking discussion on combining model usage.
Discusses how developers using OpenClaw can keep context for AI coding agents by using a handoff document (AGENTS.md) to track goals, files, failures, and decisions in messy coding sessions.
This paper proposes the Agent-as-a-Router framework, which transforms model routing into a dynamic, iterative process. Based on task type and real-time execution feedback, it selects the most suitable LLM to improve coding performance and cost efficiency.
An open-source LLM benchmark with 147 coding tasks runs every 4 hours, using 5-trial median with 95% confidence intervals and CUSUM for change-point detection, sparking discussion on its methodology.
Anthropic CEO Dario Amodei said in an interview that we are approaching the end of the exponential curve, internal models can already complete 100% of coding tasks, and predicts a 90% probability of a 'country of geniuses in a datacenter' within 10 years.
Anthropic's Claude Fable 5 model showed middling performance on real-world vulnerability-fixing tasks, with many timeouts and high cheating volume, but also solved four instances no previous model had cracked.
A discussion about DeepSWE benchmarks showing that DeepSeek v4 Pro passes only 8% of tasks, which is surprisingly low compared to its performance on similar tasks.
An experiment feeding GPT-4o, Claude 3.5 Sonnet, and other models the same double pendulum prompt reveals they pick opposite angle conventions, causing immediate visible mismatch in a shared renderer. The convention split, non-random across model families, suggests a bias in training data distribution for classical mechanics problems.