you can just watch a language model think now. i built a way to visualize the words AI doesn’t say

Reddit r/artificial Tools

Summary

A developer built Subtext, a tool that visualizes the internal 'silent words' of language models using Anthropic's Jacobian lens, allowing real-time observation of the model's reasoning before it outputs tokens. The tool runs on a single 12GB GPU and streams at full generation speed.

anthropic published the J-space paper today. tl;dr: models have a small emergent set of internal “silent words” (~a few dozen concepts at a time, <10% of activations) that they can report on, control, and use for reasoning. the measurement tool is the jacobian lens and they open sourced it, and neuronpedia posted pre-fitted lenses for qwen. so the obvious next step was to wire it into a chat UI and just… look at it. subtext runs qwen3.5-4B in bf16 on a single 12GB GPU and reads the lens at 9 layers on every token — both while the model reads your message and while it replies. streams at full generation speed (the lens is just a matmul + unembed per layer, basically free). favorite moment: type “is this correct? 12 + 5 = 1” and incorrect lights up mid-network while it’s still reading the equation. zero reply tokens exist at this point. the verdict is just sitting there, internally, before the model says anything. repo: https://github.com/ninjahawk/Subtext no GPU: recorded session replays in the browser: https://ninjahawk.github.io/Subtext/ paper: https://www.anthropic.com/research/global-workspace the live readout path is verified against anthropic’s reference implementation — audit script in the repo, top-5 matches exactly at every layer/position tested, cosine 0.99998. that’s it. questions welcome.
Original Article

Similar Articles

Anthropic found a hidden space where Claude puzzles over concepts

MIT Technology Review

Anthropic developed the Jacobian lens (J-lens) to reveal a hidden 'J-space' inside Claude Opus 4.6, offering unprecedented insight into an LLM's internal reasoning process before it outputs tokens. The technique allows monitoring and control of model behavior by surfacing the words the model is about to produce.