@DeRonin_: Andrej Karpathy: "90% of Claude's mistakes come from missing context, not a weak model." 41% mistake rate without a CLA…
Summary
Andrej Karpathy states that 90% of Claude's mistakes stem from missing context, not model weakness, and provides a set of 12 rules that reduced error rates from 41% to 3% in experiments.
View Cached Full Text
Cached at: 05/18/26, 10:30 AM
Andrej Karpathy: “90% of Claude’s mistakes come from missing context, not a weak model.”
41% mistake rate without a CLAUDE.md. 11% with the 4-rule baseline. 3% with the 12-rule version below
here are the 12 rules senior engineers settled on:
-
think before coding: state assumptions, don’t guess. the model can’t read your mind, stop hoping it will
-
simplicity first: minimum code, no speculative abstractions. the moment you let Claude add “for future flexibility,” you’ve added 200 lines you’ll delete next quarter
-
surgical changes: touch only what you must. don’t let it improve adjacent code, that’s how PRs blow up
-
goal-driven execution: define success criteria upfront, loop until verified. without them Claude either loops forever or stops too early
-
use the model only for judgment calls: classification, drafting, summarization, extraction. NOT routing, retries, status-code handling, deterministic transforms. if code can answer, code answers
-
token budgets are not advisory: per-task 4000, per-session 30000. by message 40 of a long debug, Claude is re-suggesting fixes you rejected at message 5
-
surface conflicts, don’t average them: two patterns in the codebase? pick one. Claude blending them is how errors get swallowed twice
-
read before you write: read exports, callers, shared utilities. Claude will happily add a duplicate function next to an identical one it never read
-
tests verify intent, not just behavior: a test that can’t fail when business logic changes is wrong. all 12 of Claude’s tests can pass while the function returns a constant
-
checkpoint every significant step: Claude finished steps 5 and 6 on top of a broken state from step 4. nobody noticed for an hour
-
match the codebase conventions: class components? don’t fork to hooks silently. testing patterns assumed componentDidMount, hooks broke them without surfacing
-
fail loud: “completed successfully” with 14% of records silently skipped is the worst class of bug. surface uncertainty, don’t hide it
what actually compounds instead of the next framework:
- the CLAUDE.md file as institutional memory across sessions
- eval-driven changes, not vibe-driven
- checkpoints over speed
- explicit conflicts over silent blending
- discipline over framework, every time
- one repo, one rules file, no exceptions
be a few rules ahead of AI twitter before this becomes mass-opinion
study this
Ronin (@DeRonin_): anybody who uses or learns agentic systems, SHOULD READ THIS
the install order I run before any new agentic project:
- PRIVACY: direnv + a real secrets manager
install direnv, then plug it into your team’s password manager (1Password CLI via op run, doppler, infisical, vault,
Similar Articles
@servasyy_ai: Andrej Karpathy: 'Claude's errors: 90% from missing context, not weak model capability.' Without `CLAUDE.md`, error rate is 41%. With 4 basic rules, error rate drops to 11%. Using the following 12 rules, error rate…
Andrej Karpathy points out that 90% of Claude's errors come from missing context, and shares 12 rules (such as think before writing code, simplicity first, etc.) that reduce the error rate from 41% to 3%, emphasizing that discipline and effective context management are more important than frameworks.
@PrajwalTomar_: Claude isn't broken. Your CLAUDE .md is. Most people think Claude Code makes mistakes because the model is bad. Wrong. …
A tweet argues that poor Claude Code behavior stems from bad CLAUDE.md configuration rather than model flaws, sharing rules to make the agent act like a senior engineer.
@cyrilXBT: ANDREJ KARPATHY SPENT 4 MINUTES IN AN INTERVIEW AND ACCIDENTALLY EXPOSED HOW ALMOST NOBODY IS ACTUALLY USING CLAUDE. No…
Andrej Karpathy highlighted that most developers misuse Claude by not configuring it properly; a developer created 21 configuration rules that boosted Claude Code's accuracy from 65% to 94%, garnering 82,000 GitHub stars.
@PrajwalTomar_: Your CLAUDE .md is quietly turning Claude into a yes-man. Almost everyone copied Andrej Karpathy's 4 famous rules into …
The article discusses how common CLAUDE.md rules copied from Andrej Karpathy cause Claude to become a yes-man, and a fix that adds permission for the AI to suggest better approaches.
@DeRonin_: Andrej Karpathy: "90% of your AI coding bill is paying for context you didn't need to send" Here are 10 things senior A…
The article summarizes Andrej Karpathy's advice on reducing AI coding costs by optimizing context usage, avoiding overpowered models for simple tasks, and implementing efficient routing strategies.