you can just watch a language model think now. i built a way to visualize the words AI doesn’t say
Summary
A developer built Subtext, a tool that visualizes the internal 'silent words' of language models using Anthropic's Jacobian lens, allowing real-time observation of the model's reasoning before it outputs tokens. The tool runs on a single 12GB GPU and streams at full generation speed.
Similar Articles
@AnthropicAI: New Anthropic research: A global workspace in language models. Of everything happening in your brain right now, only a …
Anthropic's new research discovers a 'global workspace' in language models analogous to conscious processing in the human brain, finding a divide similar to conscious and unconscious thought.
@TIME: Language models understand words. World models could help AI understand the world itself. TIME's Tharin Pillay spoke wi…
TIME highlights the concept of world models as a step beyond language models for AI understanding, featuring a conversation with Oliver Cameron of Odyssey at AMD's Advancing AI event.
@ctatedev: Tiny models are becoming software primitives This 27.5KB model runs locally in your browser, syntax-highlighting code w…
A tiny 27.5KB AI model called gpu-lexer from Vercel Labs runs locally in the browser using WebGPU to syntax-highlight code in any programming language without prior knowledge.
I built a tool that shows you what GPT-2 is "thinking" in real-time as it generates 3D graph of concept activations per token [R]
A developer built AXON, a tool that visualizes GPT-2's internal concept activations as a live 3D force graph using Sparse Autoencoders, allowing users to see interpretable features firing before token generation.
I study how AI organizes meaning internally. Here's what Qwen 2.5 looks like before it starts thinking.
The author visualizes Qwen 2.5 7B's input embedding space as an 'Embedding Sea' topographic map and discusses interpretability tools like logit lens and Jacobian lens. They highlight a trend of AI models optimizing for code over conversation and propose building a creativity-focused AI model with introspection capability.