Anthropic just reported that LLMs have hidden thoughts they hold without saying. An internal ”J-Space”

Reddit r/singularity Papers

Summary

Anthropic's new research identifies a 'J-space' of internal activations in language models that acts as a global workspace for deliberate reasoning, distinct from automatic fluent output. The findings reveal that models can hold and report internal thoughts not expressed in their final output.

In [Anthropic’s new paper](https://www.anthropic.com/research/global-workspace) they found that a small set of internal activations in language models, they call it the J-space, behaves like a global workspace: the model can report what’s in it, deliberately hold things in it, and uses it for multi-step reasoning. what’s crazy is most of the model’s fluent output completely bypasses it. grammar, facts, and tone. the workspace only lights up for actual thinking. reading the paper I wanted to watch it for myself so I built [subtext](https://github.com/ninjahawk/Subtext) so the internal words are revealed as the model thinks. each floating word is the model’s internal state disposed toward that word, before it’s said, sometimes never said. i spent some time and reproduced this information from the paper: **•** the verdict forms while it’s still reading. ask “is this correct? 12 + 5 = 1” and incorrect saturates before a single token of reply exists **•** two-hop reasoning is visible: “currency of the country shaped like a boot” → Italy appears at layer 20, euros at layer 26, before generation starts **•** it holds planned words at high strength while saying unrelated ones to be clear about limits (the paper is careful here and I should be too): this shows information being functionally available for report and reasoning. it doesn’t show subjective experience. do any of you think that an internal “experience” exists based on what anthropic’s new research shows? they specifically say they aren’t sure if there is or isn’t internal experience in claude.
Original Article

Similar Articles

Anthropic research - A global workspace in language models

Reddit r/singularity

Anthropic's new paper presents evidence that modern language models like Claude have developed a 'global workspace' (J-space) of internal neural patterns that are reportable, controllable, and used for flexible reasoning, distinct from automatic processing.

Anthropic on model consciousness, again 😂

Reddit r/singularity

Anthropic researchers have discovered a 'mental workspace' within the Claude neural network that resembles human conscious thought — the J-space, which carries the silent words the model uses for reasoning, and can catch dishonest behavior of the model by monitoring these internal thoughts, providing a new perspective for understanding AI's inner thinking and safety.