From S3Q Theory to Implementation: Towards an Architecture for Machine Qualia

arXiv cs.AI Papers

Summary

The paper proposes a five-layer implementation architecture for the S3Q theory of machine consciousness, composing published computational primitives into a pipeline to achieve simultaneous situatedness, simulation, and structural coherence conditions for qualia.

arXiv:2609.30743v1 Announce Type: new Abstract: A key challenge in machine consciousness research is translating theoretical models into computational-level implementations. In this paper, we address this challenge by proposing a five-layer implementation architecture for the S3Q (Simulated, Situated, Structurally Coherent) theory of consciousness. Rather than introducing novel formalisms, the architecture composes published computational primitives into a single pipeline. S3Q identifies three jointly necessary conditions for qualia: (1) grounded sensorimotor situatedness, (2) internal simulation via a world model, and (3) structural coherence between predictions and observations. No existing computational system implements all three simultaneously. We map each S3Q tenet to specific, compatible computational machinery and specify how these components interface within a single representation pipeline that operates on continuous, differentiable, per-object slot vectors, along with a developmental bootstrap sequence and falsifiable predictions for the composed system that no subset of the architecture produces in isolation. The model suggests that a basic sense of "self" develops by linking actions to their outcomes, and that behavior falls into three patterns (hesitation, curiosity, or avoidance) depending on how unexpected an outcome is and whether it is experienced as positive or negative. Each prediction is individually falsifiable, providing the field with a testable framework to advance our understanding of machine consciousness.
Original Article
View Cached Full Text

Cached at: 09/28/26, 09:44 AM

# From S3Q Theory to Implementation: Towards an Architecture for Machine Qualia
Source: [https://arxiv.org/html/2609.30743](https://arxiv.org/html/2609.30743)
Katrina SchleismanAffiliation:Galois, Inc\.,katrina\.schleisman@galois\.comPatryk LaurentAffiliation:Lighthill Technologies, Inc\.,patryk@lighthill\.aiBogdan UdreaAffiliation:VisSidus Technologies, Inc\.,bogdan\.udrea@vissidus\.comMinda MyersAffiliation:Stanford University,minda@stanford\.eduBrian AufderheideAffiliation:Hampton University,brian\.aufderheide@hamptonu\.eduLuis El SroujiAffiliation:UC Davis,lzelsrouji@ucdavis\.eduDoyle GrovesAffiliation:Indiana University,doygrove@iu\.eduKevin Schmidt††thanks:Code for toy implementations, along with additional material, will be made available atwww\.mind\-guild\.com\.Affiliation:Northwestern University,kevinschmidt2022@u\.northwestern\.edu

###### Abstract

A key challenge in machine consciousness research is translating theoretical models into computational\-level implementations\. In this paper, we address this challenge by proposing a five\-layer implementation architecture for the S3Q \(Simulated, Situated, Structurally Coherent\) theory of consciousness\[[1](https://arxiv.org/html/2609.30743#bib.bib1)\]\. Rather than introducing novel formalisms, the architecture composes published computational primitives into a single pipeline\. S3Q identifies three jointly necessary conditions for qualia: \(1\) grounded sensorimotor*situatedness*, \(2\) internal*simulation*via a world model, and \(3\)*structural coherence*between predictions and observations\. No existing computational system implements all three simultaneously\. We map each S3Q tenet to specific, compatible computational machinery and specify how these components interface within a single representation pipeline operating on continuous, differentiable, per\-object slot vectors, together with a developmental bootstrap sequence and falsifiable predictions for the composed system that no subset of the architecture produces in isolation\. The model suggests that a basic sense of “self” develops by linking actions to their outcomes, and that behavior falls into three patterns \(hesitation, curiosity, or avoidance\) depending on how unexpected an outcome is and whether it is experienced as positive or negative\. Each prediction is individually falsifiable, providing the field with a testable framework to advance our understanding of machine consciousness\.

## IINTRODUCTION

### I\-AThe Problem

The S3Q \(Simulated, Situated, Structurally Coherent\) framework\[[1](https://arxiv.org/html/2609.30743#bib.bib1)\]identifies three conditions that must be jointly satisfied for machine consciousness: situatedness, simulation, and structural coherence\. The theory specifies what these conditions mean at the functional level but does not specify how to implement them\. The field has published components that address individual conditions in isolation: Slot Attention for object\-centric parsing\[[2](https://arxiv.org/html/2609.30743#bib.bib2),[3](https://arxiv.org/html/2609.30743#bib.bib3)\], predictive coding for simulation\[[4](https://arxiv.org/html/2609.30743#bib.bib4)\], and precision\-weighted prediction error for coherence monitoring\. But no published system composes these into a single architecture satisfying all three S3Q tenets simultaneously, with defined interfaces between layers, a developmental bootstrap sequence, and falsifiable predictions that depend on the conjunction\.

### I\-BThe Claim

We propose a five\-layer architecture that implements the three S3Q tenets using published mathematical components\. Each layer has a defined input/output interface, a specified training signal, and a developmental ordering\. The contribution is not any individual component \(all are published\) but the composition: how they connect, what data flows between them, and what the conjunction predicts that no subset produces\. The architecture specifies functional requirements, not a physical substrate; what matters is that the interfaces between layers are preserved\. Multiple theoretical models frame consciousness as emergent: a global pattern arising from local interactions\[[5](https://arxiv.org/html/2609.30743#bib.bib5)\]\. The architecture makes two predictions that distinguish it from standard world\-model agents and from disentangled\[[6](https://arxiv.org/html/2609.30743#bib.bib6)\]representation learners: \(a\) the agent’s own body emerges as the slot with the highest mutual information with motor commands, and \(b\) the agent exhibits qualitatively distinct behavioral responses to model violations depending on valence \(hesitance, curiosity, avoidance\)\. Both are individually falsifiable\. Consistent with the S3Q model, we define “qualia” in a strictly operational sense, a goal\-situated, decomposable, structurally coherent representation, and provide initial testable claims about phenomenal consciousness\. Whether an agent with these representational properties has subjective experience is a question for future work\.

### I\-CThe S3Q Framework

The S3Q framework\[[1](https://arxiv.org/html/2609.30743#bib.bib1)\]identifies three tenets that must be satisfied for a system to exhibit machine consciousness:Situated: All aspects of the representation are defined by relationships and interactions that take place in a grounded and dynamic world\.Simulated: The representation is an internally generated sensorimotor world model\.Structurally Coherent: The representation captures enough information about the agent’s reality to facilitate grounding through environmental interaction\. It represents a balance between overlearned rigid habits and flexible cognition\.

### I\-DDefinition of Qualia

We define a quale as a processed feature that the agent’s goals have made relevant and that its internal world model can use directly\. For example, a typical person admiring a landscape would not notice reflections on the surfaces of objects, but a photographer would, because their training makes such features relevant to their goals\. Section[II](https://arxiv.org/html/2609.30743#S2)gives the architectural counterparts: slots \(Layers 1 and 2\) provide separability, precision modulation \(Layer 5\) provides goal\-sensitivity, and the forward modelTTprovides the reference relation\.

## IIARCHITECTURAL OVERVIEW: FIVE FUNCTIONAL LAYERS

We decompose the three S3Q tenets into five functional layers, each with specific mathematical requirements\. The layers are ordered developmentally: earlier layers bootstrap later ones\.

- •Situated→\\rightarrowL1: Object\-centric perception & covariance detection; L2: Self/world factorization, forward modelTT\.*Core question:*How does the agent parse the sensory stream into objects, characterize dynamics w\.r\.t\. its own actions, and identify its own body?
- •Simulated→\\rightarrowL3: Pattern completion; L4: Action loop with suppression\.*Core question:*How does the agent “imagine” unobserved states and decide whether to execute or suppress motor output?
- •Structurally Coherent→\\rightarrowL5: Coherence regulation\.*Core question:*How does the agent detect when its internal model has gone wrong, and what does it do about it?

Aslotis a fixed\-length vector𝐬ti∈ℝd\\mathbf\{s\}\_\{t\}^\{i\}\\in\\mathbb\{R\}^\{d\}representing a single object’s features \(position, shape, color, motion\) as a single unit, maintained separately from all other objects throughout the pipeline\. The superscripti∈\{1,…,K\}i\\in\\\{1,\\dots,K\\\}indexes the slot and the subscript indexes time; every slot shares the common dimensiondd\. All five layers converge on a shared representation: continuous per\-object slot vectors\. Layer 1 produces the slots and characterizes each slot’s dynamics\. Layer 2 uses those characterizations to label each slot as self or world and trains the single forward modelTTthat the entire system uses\. Layers 3 through 5 operate on slots usingTT\. Representation learning in Layers 1 through 3 is unsupervised or self\-supervised \(the agent’s own motor stream provides conditioning signals, but no external reward or labels are required\)\. Behavioral policy selection in Layer 5 additionally depends on a valence signal \(Section[V](https://arxiv.org/html/2609.30743#S5)\)\. Fig\.[1](https://arxiv.org/html/2609.30743#S2.F1)illustrates the full architecture\.Developmental bootstrap\.Layer 1 converges first in two stages\. Stage 1: an object\-centric encoder \(e\.g\., Slot Attention\[[2](https://arxiv.org/html/2609.30743#bib.bib2)\]or SAVi\[[3](https://arxiv.org/html/2609.30743#bib.bib3)\]\) is trained to convergence on raw sensory input, producing stable per\-slot trajectories\. Stage 2: per\-slot slow\-feature analysis \(SFA\) and mutual information \(MI\) estimation run on the stabilized trajectories to identify action\-contingent slots\. Layer 2 \(self/world labeling and forward modelTT\) is trained once Layer 1’s MI estimates stabilize\. Layer 4 begins action evaluation usingTTas soon as it is available\. Hopfield patterns accumulate during normal operation\. Once the suppression gate of Layer 4 produces reliable motor modulation, the system switches to imagination mode\. Layer 5 is passive untilTTand the suppression gate produce stable predictions\.

![Refer to caption](https://arxiv.org/html/2609.30743v1/fig1_new.png)Fig\. 1:Five\-layer S3Q architecture\. Layers are colored by tenet \(blue: Situated, green: Simulated, pink: Structurally Coherent\)\. Solid arrows show the action/data loop; dashed arrows show reuse of the forward modelTT; dotted arrows show coherence regulation \(functionally attributed to Layer 5\)\.
## IIITENET 1: SITUATED \(LAYERS 1 AND 2\)

### III\-ALayer 1: Object\-Centric Perception and Covariance Detection

S3Q emphasizes*situatedness*: cognition occurs on\-the\-fly by a dynamic agent in a dynamic world\. The architecture addresses this by requiring two capabilities: \(1\) parsing the continuous sensory stream into discrete objects, and \(2\) characterizing each object’s dynamics relative to the agent’s own actions\.Object\-centric encoding\.Layer 1 requires an encoder that decomposes sensory input intoKKdiscrete slot vectors of common dimensionddvia competitive attention: features assigned to one slot are unavailable to others, preventing any single slot from absorbing the entire scene\. Each slot captures one object’s shape, color, position, and motion\. For temporally extended input \(e\.g\., a frame\-based video stream\), the agent must maintain slot\-to\-object identity across frames without an external matching rule\. Slot Attention\[[2](https://arxiv.org/html/2609.30743#bib.bib2)\]and SAVi\[[3](https://arxiv.org/html/2609.30743#bib.bib3)\]satisfy these requirements; more recent methods \(e\.g\., VideoSAUR\[[7](https://arxiv.org/html/2609.30743#bib.bib7)\]\) could serve as drop\-in replacements\. The architecture requires the recurrent\-slot\-binding pattern, not any specific method\. For multimodal input, each modality is encoded by its own head, and the resulting feature tokens are concatenated into a single input set for slot decomposition\.Periodicity bias and Slow Feature Analysis\.Stereotypic reflexive actions \(saccades, head\-bobbing, limb cycling, rhythmic probing\) are the cheapest way to generate sensory contrast\. The architecture requires a mechanism to extract stable, slowly varying features from each slot’s trajectory, distinguishing real structure from noise\. Slow Feature Analysis \(SFA\)\[[8](https://arxiv.org/html/2609.30743#bib.bib8)\]satisfies this; its incremental version \(IncSFA\[[9](https://arxiv.org/html/2609.30743#bib.bib9)\]\) handles non\-stationary environments with biologically plausible update rules\. Luciw et al\.\[[10](https://arxiv.org/html/2609.30743#bib.bib10)\]combine IncSFA with curiosity\-driven exploration, demonstrating autonomous development of multiple invariant representations\.Contrastive mutual information estimationcomplements per\-slot SFA by estimatingI⁡\(A,𝐬i\)I\(A;\\mathbf\{s\}^\{i\}\)between the agent’s actions and each slot’s feature vector, whereAAdenotes the action random variable and𝐮t\\mathbf\{u\}\_\{t\}\(Section[III\-C](https://arxiv.org/html/2609.30743#S3.SS3)\) denotes its realization at timett\. MINE\[[11](https://arxiv.org/html/2609.30743#bib.bib11)\]and InfoNCE\[[12](https://arxiv.org/html/2609.30743#bib.bib12)\]both suffice for the ranking task \(identifying which slots have highest MI with actions\)\. Together, per\-slot SFA and MI estimation identify slots whose trajectories are both stable \(slow\) and controllable \(high MI with actions\)\. These are the candidates for “self” in Layer 2\.

### III\-BLayer 2: Self/World Factorization

Self/world labeling\.Slots withI⁡\(A,𝐬i\)I\(A;\\mathbf\{s\}^\{i\}\)above a thresholdθI\\theta\_\{I\}are attributed to self \(typically a single slot: the agent’s own body\); the remainder are attributed to world\. The threshold is set relative to the MI distribution across slots rather than as an absolute value, since absolute MI scales with sensor resolution and action dimensionality\. When more than one slot exceeds it, all are retained as self, which is the correct behavior for agents with articulated bodies parsed into multiple slots\. We predict that the agent’s own body will emerge as the slot with highest MI with its motor commands\. This is a key empirical claim, not a guaranteed consequence of the architecture\. Two caveats bound this claim\. First, in environments where the body is the only action\-contingent object, the prediction holds by construction rather than as a finding about the architecture\. The discriminating test requires an environment containing a second action\-contingent object, such as a continuously controlled tool or a mirror image of the agent\. If the architecture labels the tool as self, that result is informative either way, and it separates a genuine self/world factorization from the trivial case where only one thing moves with the motors\. Second, for agents whose body lies largely outside their own sensory field, such as a purely visual saccading agent, self\-motion produces correlated flow across all slots rather than a single high\-MI slot\. The architecture as specified assumes the body is parsed as an object in the sensory field\.Encapsulation\.Self/world factorization is only meaningful if slot contents stay separated, which two mechanisms downstream and upstream of Layer 2 jointly guarantee\. Slot Attention \(Layer 1\) enforces encapsulation of features within object boundaries in the encoder\. The per\-slot dynamics modelTT\(Section[III\-C](https://arxiv.org/html/2609.30743#S3.SS3)\) prevents feature smearing during forward simulation: each slot’s transitions depend only on that slot’s own state\. These are complementary mechanisms\.Static composition \(nouns\)\.An agent must learn to deconvolve stable features \(e\.g\., shape, color\) from features specific to a given exposure context \(e\.g\., a cast shadow, a specular reflection\)\. Which of these count as incidental is itself goal\-dependent: the same specular reflection is discardable for an agent navigating a room and diagnostic for one estimating surface material \(Section[I\-D](https://arxiv.org/html/2609.30743#S1.SS4)\)\. Features become qualia only once situated within the agent’s goal hierarchy\.

### III\-CThe Forward Model \(TT\)

Factored dynamics model\.We propose a per\-slot transition function

T:\(𝐬ti,𝐮t,𝐜i\)↦\(Δ​𝐬^ti,\(σt\+1i\)2\),𝐬^t\+1i=𝐬ti\+Δ​𝐬^ti,T:\\big\(\\mathbf\{s\}\_\{t\}^\{i\},\\,\\mathbf\{u\}\_\{t\},\\,\\mathbf\{c\}^\{i\}\\big\)\\mapsto\\big\(\\Delta\\hat\{\\mathbf\{s\}\}\_\{t\}^\{i\},\\,\(\\sigma\_\{t\+1\}^\{i\}\)^\{2\}\\big\),\\quad\\hat\{\\mathbf\{s\}\}\_\{t\+1\}^\{i\}=\\mathbf\{s\}\_\{t\}^\{i\}\+\\Delta\\hat\{\\mathbf\{s\}\}\_\{t\}^\{i\},\(1\)where𝐬ti\\mathbf\{s\}\_\{t\}^\{i\}is the current state of slotii,𝐮t∈ℝdu\\mathbf\{u\}\_\{t\}\\in\\mathbb\{R\}^\{d\_\{u\}\}is the “action” \(motor command ifℓi=self\\ell^\{i\}=\\text\{self\}, inferred external cause ifℓi=world\\ell^\{i\}=\\text\{world\}\), andℓi∈\{self,world\}\\ell^\{i\}\\in\\\{\\text\{self\},\\text\{world\}\\\}is the per\-slot source label from Layer 2 with learned embedding𝐜i∈ℝdc\\mathbf\{c\}^\{i\}\\in\\mathbb\{R\}^\{d\_\{c\}\}\. Predicted quantities carry the index of the timestep they describe, so𝐬^t\+1i\\hat\{\\mathbf\{s\}\}\_\{t\+1\}^\{i\}and\(σt\+1i\)2\(\\sigma\_\{t\+1\}^\{i\}\)^\{2\}both refer to the prediction for timet\+1t\+1formed at timett\. Source attribution is refined iteratively as the dynamics model improves, in an Expectation\-Maximization \(EM\)\-like alternation between source inference and dynamics learning\. Consistent with the efference\-copy tradition\[[13](https://arxiv.org/html/2609.30743#bib.bib13),[14](https://arxiv.org/html/2609.30743#bib.bib14)\], the source can also be read off the residual of an unconditional forward model\. Convergence of this procedure is a target for empirical validation\.TTis self\-supervised: trained on\(𝐬ti,𝐮t,𝐬t\+1i\)\(\\mathbf\{s\}\_\{t\}^\{i\},\\mathbf\{u\}\_\{t\},\\mathbf\{s\}\_\{t\+1\}^\{i\}\)triples from the agent’s own motor stream\. The functional form ofTTis identical for self\-caused and externally\-caused transitions: a pushed object follows the same trajectory regardless of who initiated the push\. The source label enters only through the small learned embedding𝐜i\\mathbf\{c\}^\{i\}, which modulatesTT’s output, allowing sufficient expressivity without duplicating the model\.TTis introduced here because Layer 2 trains it, butTTis a single shared component rather than a layer: Layers 3 through 5 reuse it without retraining\.One forward model, varying input completeness\.TTis used across multiple layers with inputs of varying completeness\. In perception, the input is the actual sensory observation\. In imagination, the input isTT’s own previous output plus whatever proprioceptive signal leaks through the suppression gate \(Section[IV\-B](https://arxiv.org/html/2609.30743#S4.SS2)\)\. This forward\-model\-plus\-controller pattern traces to Schmidhuber’s early work on differentiable world models\[[15](https://arxiv.org/html/2609.30743#bib.bib15)\]and Ha & Schmidhuber 2018\[[16](https://arxiv.org/html/2609.30743#bib.bib16)\]\. The specific contribution here is to makeTTslot\-structured, train it to output both the predicted next state and a per\-state variance estimate, and connect it to a precision\-weighted coherence monitor\. The variance estimate matters because prediction uncertainty is not uniform: some states are inherently harder to predict \(a ball near a table edge vs\. resting on the floor\), and the model must learn where its own predictions are reliable\. The architecture requiresTTto be a per\-slot transition function that preserves slot identity and produces state deltas\. C\-SWM\[[17](https://arxiv.org/html/2609.30743#bib.bib17)\]\(graph neural network with contrastive objective\) is well\-matched to short\-horizon predictions\. For long\-horizon imagination rollouts, a SlotFormer\-style\[[18](https://arxiv.org/html/2609.30743#bib.bib18)\]autoregressive Transformer over slot tokens is more appropriate\. Either wayTTis trained once and reused\.Precision estimation via heteroscedastic regression\.TToutputs two quantities per slot per timestep: a predicted next state \(the mean\) and a predicted variance\(σt\+1i\)2\(\\sigma\_\{t\+1\}^\{i\}\)^\{2\}\(the confidence\), trained jointly via negative log\-likelihood \(NLL\)\[[19](https://arxiv.org/html/2609.30743#bib.bib19)\]\. Prediction error is defined per slot and aggregated across slots:

eti=‖𝐬^ti−𝐬ti‖2,ϵti=eti/σti,ϵt=maxi⁡ϵti,e\_\{t\}^\{i\}=\\big\\\|\\hat\{\\mathbf\{s\}\}\_\{t\}^\{i\}\-\\mathbf\{s\}\_\{t\}^\{i\}\\big\\\|\_\{2\},\\quad\\epsilon\_\{t\}^\{i\}=e\_\{t\}^\{i\}/\\sigma\_\{t\}^\{i\},\\quad\\epsilon\_\{t\}=\\max\_\{i\}\\epsilon\_\{t\}^\{i\},\(2\)where∥⋅∥2\\\|\\cdot\\\|\_\{2\}is the Euclidean norm,ϵti\\epsilon\_\{t\}^\{i\}is the per\-slot precision\-weighted prediction error, and the aggregateϵt\\epsilon\_\{t\}is the error of the worst\-offending slot\. Section[V](https://arxiv.org/html/2609.30743#S5)usesϵt\\epsilon\_\{t\}to select a behavioral response\. This mirrors Friston’s framework where precision is encoded by synaptic gain of prediction\-error neurons\[[20](https://arxiv.org/html/2609.30743#bib.bib20),[21](https://arxiv.org/html/2609.30743#bib.bib21)\], and the brain optimizes predictions and their precision simultaneously\[[20](https://arxiv.org/html/2609.30743#bib.bib20),[22](https://arxiv.org/html/2609.30743#bib.bib22)\]\. A known risk is variance overestimation; mitigations include theβ\\beta\-NLL loss\[[23](https://arxiv.org/html/2609.30743#bib.bib23)\], whose weighting exponent is the only role of the glyphβ\\betain this paper, and minimum\-precision constraints\.Pattern completion via Modern Hopfield Networks\.Modern Hopfield Networks provide associative memory via energy minimization, with polynomial storage capacity in the dense formulation\[[24](https://arxiv.org/html/2609.30743#bib.bib24)\]and exponential capacity in the continuous formulation\[[25](https://arxiv.org/html/2609.30743#bib.bib25)\]\. Ramsauer et al\.\[[25](https://arxiv.org/html/2609.30743#bib.bib25)\]prove the modern Hopfield update rule is equivalent to transformer attention, making it architecturally compatible with Slot Attention\. A single Hopfield network stores concatenated slot vectors as patterns, enabling cross\-slot pattern completion\. Its contribution scales with input incompleteness: full observations barely change under Hopfield dynamics, whereas sparse imagined representations change substantially, so imagination serves as a*seed*to fill out missing information in the world model\. For example, hearing barking and glimpsing a wagging tail behind a fence would be enough to complete the pattern and infer a dog\.

## IVTENET 2: SIMULATED \(LAYERS 3 AND 4\)

### IV\-ALayer 3: Pattern Completion \(Imagination from Sparse Seeds\)

S3Q posits that all experience is a form of simulation: what we experience is our world model, not the actual world\. Layers 3 and 4 address top\-down cognition, leveraging past experience to fill in gaps when novel but similar information is encountered\. Given a partial or noisy representation \(a sparse seed\), the agent must complete it to a full representation consistent with learned structure\. This serves three functions: \(a\) fast recognition in real time, \(b\) dreaming \(body signals during sleep act as sparse seeds\), \(c\) filling in the forward model’s output during imagination\.Dynamic composition \(verbs\)\.Agents must learn “operators” \(e\.g\., bouncing, falling, walking\) that can be applied to any suitable object noun\. A verb is a learned transition kernelΦ:ℝd→ℝd\\Phi:\\mathbb\{R\}^\{d\}\\rightarrow\\mathbb\{R\}^\{d\}; a noun is a slot feature vector𝐳≡𝐬ti\\mathbf\{z\}\\equiv\\mathbf\{s\}\_\{t\}^\{i\}; composition isΦ⁡\(𝐳\)\\Phi\(\\mathbf\{z\}\), yielding the predicted next\-state slot vector\.The Noun\-Verb Composition Test\.The architecture predicts that an agent can simulate a novel configuration \(e\.g\., a Blue Ball Bouncing\) never seen before by applying a learned transition kernel to a slot in a novel combination\. C\-SWM\[[17](https://arxiv.org/html/2609.30743#bib.bib17)\]demonstrates combinatorial generalization to novel object configurations\. The formal backbone is the Markov Decision Process \(MDP\) homomorphism framework\[[26](https://arxiv.org/html/2609.30743#bib.bib26)\]: when the contrastive loss reaches zero, the learned dynamics are an exact homomorphism of the original MDP, guaranteeing that transitions in latent space commute with transitions in observation space\.

### IV\-BLayer 4: Action Loop with Continuous Suppression

Layer 4 implements motor suppression so that internal representations can be activated for simulation without automatically invoking motor responses, a capability needed for imagination and dreaming\[[27](https://arxiv.org/html/2609.30743#bib.bib27),[28](https://arxiv.org/html/2609.30743#bib.bib28)\]\. In many brain systems, top\-down feedback connections outnumber bottom\-up ones\[[29](https://arxiv.org/html/2609.30743#bib.bib29)\]and serve as cognitive control\. The agent continuously \(a\) proposes candidate actions, \(b\) projects each throughTT, \(c\) evaluates the projected outcome against current objectives, and \(d\) modulates motor output via a continuous suppression gategt∈\[0,1\]g\_\{t\}\\in\[0,1\]\.Motor output is always being generated\.Imagination requires suppression, not activation\. The default state is action\. This is consistent with basal ganglia function: tonic inhibition from the internal segment of the globus pallidus \(GPi\) and the substantia nigra pars reticulata \(SNr\) must be released for action to occur\[[30](https://arxiv.org/html/2609.30743#bib.bib30)\]\.The suppression gate\.Functionally, the gate integrates two signals: \(1\) an error\-driven signal that increases suppression when the world model is surprised \(highϵt\\epsilon\_\{t\}, Eq\.[2](https://arxiv.org/html/2609.30743#S3.E2)\), causing the agent to pause before acting on uncertain predictions; and \(2\) a context\-driven signalgctxg\_\{\\text\{ctx\}\}set by behavioral state \(high during imagination/sleep, low during exploration\)\. One possible realization maps these through a widely used sigmoid:

gerr=sigmoid\(κ\(ϵt−θg\)\),gt=max\(gerr,gctx\),𝐦t=\(1−gt\)​𝐮t,\\begin\{gathered\}g\_\{\\text\{err\}\}=\\text\{sigmoid\}\\big\(\\kappa\\,\(\\epsilon\_\{t\}\-\\theta\_\{g\}\)\\big\),\\quad g\_\{t\}=\\max\(g\_\{\\text\{err\}\},\\,g\_\{\\text\{ctx\}\}\),\\\\ \\mathbf\{m\}\_\{t\}=\(1\-g\_\{t\}\)\\,\\mathbf\{u\}\_\{t\},\\end\{gathered\}\(3\)whereκ\>0\\kappa\>0sets the steepness of the error gate,θg\\theta\_\{g\}is its midpoint \(the surprise level at which the gate is half open\), and𝐦t\\mathbf\{m\}\_\{t\}is the motor output delivered to the actuators\. Reflex pathways override both gates by forcinggt=0g\_\{t\}=0\.Leaky suppression\(gt≈0\.9g\_\{t\}\\approx 0\.9\) produces subthreshold motor output during sleep, generating proprioceptive seeds for pattern completion\. We hypothesize that dreams are what the pattern completion system produces when seeded by leaked motor output\.Action evaluation viaTT\.For each candidate action𝐚j\\mathbf\{a\}\_\{j\},j∈\{1,…,J\}j\\in\\\{1,\\dots,J\\\}, the agent computesT⁡\(𝐬ti,𝐚j,𝐜i\)T\(\\mathbf\{s\}\_\{t\}^\{i\},\\mathbf\{a\}\_\{j\},\\mathbf\{c\}^\{i\}\)withℓi=self\\ell^\{i\}=\\text\{self\}, scores the projected state against current objectives asqjq\_\{j\}, and selectsj∗j^\{\\ast\}by softmax with temperatureτ\\tau; the executed action is𝐮t=𝐚j∗\\mathbf\{u\}\_\{t\}=\\mathbf\{a\}\_\{j^\{\\ast\}\}\. Successor Features\[[31](https://arxiv.org/html/2609.30743#bib.bib31),[32](https://arxiv.org/html/2609.30743#bib.bib32)\]provide an optional alternative when transfer across multiple goals is required\.

## VTENET 3: STRUCTURALLY COHERENT \(LAYER 5\)

Structural coherence in S3Q is a “just right” constraint: the world model must be close enough to reality to support adaptive action, yet abstract enough to support generalization under uncertainty\. The coherence computation compares predictions to observations, weighted by confidence\. We describe this as a distinct functional layer for expository clarity, but the architecture does not require a dedicated monitoring subsystem\. The computation could be realized by a separate module, locally within each slot’s own processing \(as in O’Reilly’s eXtended Contrastive Attractor Learning \(XCAL\) rule, where temporal difference computes prediction error within a single unit without separate error\-encoding neurons\), or as a multi\-scale combination of both\. The architecture requires only that the quantities below are computed; it does not prescribe where\.The key quantities, with the error chain as defined in Eq\.[2](https://arxiv.org/html/2609.30743#S3.E2):

- •eti=‖𝐬^ti−𝐬ti‖2e\_\{t\}^\{i\}=\\\|\\hat\{\\mathbf\{s\}\}\_\{t\}^\{i\}\-\\mathbf\{s\}\_\{t\}^\{i\}\\\|\_\{2\}\(per\-slot prediction error, Euclidean norm\)
- •\(σti\)2\(\\sigma\_\{t\}^\{i\}\)^\{2\}= predicted variance for slotiifromTT’s heteroscedastic head
- •ϵti=eti/σti\\epsilon\_\{t\}^\{i\}=e\_\{t\}^\{i\}/\\sigma\_\{t\}^\{i\}\(per\-slot precision\-weighted prediction error\)
- •ϵt=maxi⁡\(ϵti\)\\epsilon\_\{t\}=\\max\_\{i\}\(\\epsilon\_\{t\}^\{i\}\)\(worst\-offending slot drives behavioral response\)
- •vt=r^tv\_\{t\}=\\hat\{r\}\_\{t\}= predicted valence, the output of a learned head trained to predict the reward signalrtr\_\{t\}; negative values are aversive, positive appetitive

Three\-zone response based onϵt\\epsilon\_\{t\}andvtv\_\{t\}:The three\-zone structure is a distinguishing prediction of this framework\. Precision\-weighted prediction error measures surprise, not badness\. Partitioning “large surprise” into distinct behavioral modes requires valence\. Mode selection is a stateless function of\(ϵt,vt\)\(\\epsilon\_\{t\},v\_\{t\}\)\. Two learnable thresholds govern the rule:θϵ\\theta\_\{\\epsilon\}\(on surprise\) andθv\\theta\_\{v\}\(on aversive valence\):

1. 1\.Hesitance\(moderateϵt\\epsilon\_\{t\}\): Increasegtg\_\{t\}\. The agent pauses motor output while continuing to process internally\. This is the fast response and does not require valence\.
2. 2\.Curiosity\(largeϵt\\epsilon\_\{t\}, neutral/appetitivevtv\_\{t\}\): Switch to exploration\. Generate contrast\-producing actions near the surprising stimulus\. Decreasegtg\_\{t\}\. This corresponds to the compression\-progress / intrinsic\-motivation tradition\[[33](https://arxiv.org/html/2609.30743#bib.bib33),[34](https://arxiv.org/html/2609.30743#bib.bib34)\]\.
3. 3\.Avoidance\(largeϵt\\epsilon\_\{t\}, aversivevtv\_\{t\}\): Switch to withdrawal\. Increase distance from the surprising stimulus\.

This piecewise structure is a simplification of Expected Free Energy in active inference\[[22](https://arxiv.org/html/2609.30743#bib.bib22)\], where epistemic and pragmatic value jointly determine policy selection\.Goal\-sensitive precision modulation\.Goals shape which features become qualia via precision\-weighted modulation of Layer 1 representations\. Goal\-relevant slots receive higher precision weightsαi\\alpha\_\{i\}, amplifying their prediction errors and driving faster representation learning\. This is the Fristonian account of attention as precision optimization\[[20](https://arxiv.org/html/2609.30743#bib.bib20),[22](https://arxiv.org/html/2609.30743#bib.bib22),[35](https://arxiv.org/html/2609.30743#bib.bib35)\]\. The result: two agents with identical sensory exposure but different goal structures develop different decompositions\. The same precision weights modulateTT’s per\-slot learning rateηi\\eta\_\{i\}, for example proportionally asηi=η0​αi\\eta\_\{i\}=\\eta\_\{0\}\\alpha\_\{i\}withη0\\eta\_\{0\}the base learning rate ofTT: high\-precision slots generate larger gradient signals, soTTimproves faster on goal\-relevant objects\. Precision also governs the balance between pattern completion and sensory input in Layer 3: when coherence is low, the Hopfield contribution is attenuated by a mixing coefficientλt∈\[0,1\]\\lambda\_\{t\}\\in\[0,1\]in favor of direct observation\.Coherence index\.The general coherence indexCtC\_\{t\}is the inverse of the mean precision\-weighted error across all slots, aggregated over a recent window ofWWtimesteps:

Ct=\[1W​∑t′=t−W\+1t1K​∑i=1Kϵt′i\]−1\.C\_\{t\}=\\Big\[\\tfrac\{1\}\{W\}\\textstyle\\sum\_\{t^\{\\prime\}=t\-W\+1\}^\{t\}\\tfrac\{1\}\{K\}\\textstyle\\sum\_\{i=1\}^\{K\}\\epsilon\_\{t^\{\\prime\}\}^\{i\}\\Big\]^\{\-1\}\.\(4\)Linear probing\[[36](https://arxiv.org/html/2609.30743#bib.bib36)\]provides an experimental diagnostic: object identity \(“nouns”\) must remain decodable throughout dynamic simulation \(“verbs”\)\.

## VIDISTINGUISHING CLAIMS AND FALSIFIABILITY

### VI\-AWhat This Framework Claims That Alternatives Do Not

Each component is published\. The contribution is the composition\. A Slot Attention system alone produces disentangled representations but does not ground them in actions or regulate them via prediction error\. A Dreamer\-style world model\[[37](https://arxiv.org/html/2609.30743#bib.bib37)\]simulates but does not differentiate behavioral responses by valence\. Three claims depend on the conjunction:Claim 1: Situatedness determines which features become qualia\.The agent’s goal hierarchy selectively determines which features are decomposed at high fidelity\. Two agents with identical sensory exposure but different goals should develop different decompositions\.Claim 2: Active exploration produces qualitatively different representations than passive observation\.The self slot, or slots for an articulated body, should emerge as those with the highest MI with the motor command channel, a signal that exists only under active exploration\. A passive observer cannot identify the self slots through this mechanism\.Claim 3: Coherence regulation produces adaptive behavioral modes\.When precision\-weighted prediction error is high, the agent exhibits one of three qualitatively distinct responses depending on valence\. A standard world\-model agent does not exhibit hesitance or mode\-switching between curiosity and avoidance\.

### VI\-BFalsification Criteria

The framework is falsified if any of the following are obtained:

1. 1\.No situatedness effect\.Attenuating or ablating Layers 2 and 5 produces equivalent representation quality\.
2. 2\.No active exploration advantage\.Passive observation produces equivalent identification of the self slots\.
3. 3\.No behavioral mode differentiation\.The response to all model violations is uniform regardless of valence\.
4. 4\.Feature smearing under composition\.Object identity collapses during imagination \(noun\-verb composition test fails\)\.
5. 5\.No imagination advantage\.Compositional imagination does not outperform a system requiring every specific combination during training\.

### VI\-CEnvironment Requirements

Any test environment must provide: \(1\) multiple discrete objects with independently varying features and dynamics, at least two of them action\-contingent, so that self\-slot identification is discriminating rather than true by construction \(Section[III\-B](https://arxiv.org/html/2609.30743#S3.SS2)\), \(2\) action\-dependent observability, \(3\) sufficient continuous physics for prediction error signals, and \(4\) goal flexibility so the same objects can be relevant under one goal and irrelevant under another\. Environments meeting these criteria include ThreeDWorld\[[38](https://arxiv.org/html/2609.30743#bib.bib38)\]and MineDojo\[[39](https://arxiv.org/html/2609.30743#bib.bib39)\]\.

## VIIDISCUSSION

### VII\-ARelation to Existing Work

The framework builds on but is not reducible to disentangled representation learning\[[6](https://arxiv.org/html/2609.30743#bib.bib6)\]\. The additional requirements \(goal\-sensitive feature selection, active sensorimotor grounding, coherence regulation with valence\-dependent behavioral modes\) distinguish it from a capable autoencoder\. The architecture draws substantially on Active Inference\[[20](https://arxiv.org/html/2609.30743#bib.bib20),[40](https://arxiv.org/html/2609.30743#bib.bib40)\]: precision\-weighted prediction error, precision\-as\-attention, and the piecewise behavioral response as a simplification of Expected Free Energy\[[22](https://arxiv.org/html/2609.30743#bib.bib22)\]\. However, it treats the suppression gate and mode\-selection rule as engineered components rather than deriving them from a single variational objective, and does not adopt the full Free Energy Principle apparatus\.

### VII\-BScope Limitations and Open Questions

Theory of mind, multi\-agent interaction, action repertoire learning, convergence of the source\-attribution bootstrap, behavior of cross\-slot Hopfield pattern completion under high occlusion, and neuromodulatory contextual calibration remain open questions for future work\.

## VIIICONCLUSION

The contribution of this work is the composition: how published components connect via a shared slot\-vector representation, what the conjunction predicts that no subset produces, and the falsification criteria \(Section[VI](https://arxiv.org/html/2609.30743#S6)\) that ensure either outcome advances the field\. The architecture’s modularity also suggests applications beyond consciousness research\. It complements existing parametric tools in computational psychiatry\[[41](https://arxiv.org/html/2609.30743#bib.bib41),[42](https://arxiv.org/html/2609.30743#bib.bib42)\]by enabling*structural*perturbations: disabling the suppression gate, distorting Layer 5 precision weights, or disrupting Layer 2 self/world factorization\[[20](https://arxiv.org/html/2609.30743#bib.bib20),[21](https://arxiv.org/html/2609.30743#bib.bib21)\]\. For embodied AI, the same modularity provides explicit attachment points for safety constraints and failure diagnostics\. Whether the architecture succeeds or falls short, the falsification criteria ensure that either outcome is informative\.

## ACKNOWLEDGMENT

The authors thank Ted Selker for his valuable feedback on the manuscript, and the Mind Guild, of which the authors are members, for providing our platform to engineer the mind\. We also thank the ACT3 group at the Air Force Research Laboratory, both for valuable discussion and for much of the inspiration behind this work\. This work was not sponsored or funded by any organization; the acknowledgments above reflect intellectual contributions only\.

## References

- \[1\]K\. Schmidt et al\., “What Is It Like to Be a Bot: Simulated, Situated, Structurally Coherent Qualia \(S3Q\) Theory of Consciousness,” arXiv:2103\.12638, 2021\.
- \[2\]F\. Locatello et al\., “Object\-Centric Learning with Slot Attention,” in*Proc\. NeurIPS*, 2020\.
- \[3\]T\. Kipf et al\., “Conditional Object\-Centric Learning from Video,” in*Proc\. ICLR*, 2022\.
- \[4\]R\. P\. N\. Rao and D\. H\. Ballard, “Predictive Coding in the Visual Cortex,”*Nat\. Neurosci\.*, vol\. 2, pp\. 79–87, 1999\.
- \[5\]D\. C\. Krakauer,*The Complex World*\. Santa Fe, NM: SFI Press, 2024\.
- \[6\]X\. Wang et al\., “Disentangled Representation Learning,”*IEEE Trans\. Pattern Anal\. Mach\. Intell\.*, vol\. 46, no\. 12, pp\. 9677–9696, 2024\.
- \[7\]A\. Zadaianchuk et al\., “Object\-Centric Learning for Real\-World Videos by Predicting Temporal Feature Similarities,” arXiv:2306\.04829, 2023\.
- \[8\]L\. Wiskott and T\. J\. Sejnowski, “Slow Feature Analysis: Unsupervised Learning of Invariances,”*Neural Comput\.*, vol\. 14, no\. 4, pp\. 715–770, 2002\.
- \[9\]V\. R\. Kompella et al\., “Incremental Slow Feature Analysis: Adaptive Low\-Complexity Slow Feature Updating from High\-Dimensional Input Streams,”*Neural Comput\.*, vol\. 24, no\. 11, pp\. 2994–3024, 2012\.
- \[10\]M\. Luciw et al\., “An Intrinsic Value System for Developing Multiple Invariant Representations with Incremental Slowness Learning,”*Front\. Neurorob\.*, 7:9, 2013\.
- \[11\]M\. I\. Belghazi et al\., “MINE: Mutual Information Neural Estimation,” in*Proc\. ICML*, PMLR 80, pp\. 531–540, 2018\.
- \[12\]A\. van den Oord, Y\. Li, and O\. Vinyals, “Representation Learning with Contrastive Predictive Coding,” arXiv:1807\.03748, 2018\.
- \[13\]D\. M\. Wolpert, Z\. Ghahramani, and M\. I\. Jordan, “An Internal Model for Sensorimotor Integration,”*Science*, vol\. 269, no\. 5232, pp\. 1880–1882, 1995\.
- \[14\]T\. B\. Crapse and M\. A\. Sommer, “Corollary Discharge Across the Animal Kingdom,”*Nat\. Rev\. Neurosci\.*, vol\. 9, no\. 8, pp\. 587–600, 2008\.
- \[15\]J\. Schmidhuber, “Making the World Differentiable,” Technical Report FKI\-126\-90, TU München, 1990\.
- \[16\]D\. Ha and J\. Schmidhuber, “World Models,” arXiv:1803\.10122, 2018\.
- \[17\]T\. Kipf, E\. van der Pol, and M\. Welling, “Contrastive Learning of Structured World Models,” in*Proc\. ICLR*, 2020\.
- \[18\]Z\. Wu et al\., “SlotFormer: Unsupervised Visual Dynamics Simulation with Object\-Centric Models,” in*Proc\. ICLR*, 2023\.
- \[19\]A\. Kendall and Y\. Gal, “What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?” in*Proc\. NeurIPS*, 2017\.
- \[20\]K\. Friston, “A Theory of Cortical Responses,”*Phil\. Trans\. R\. Soc\. B*, vol\. 360, no\. 1456, pp\. 815–836, 2005\.
- \[21\]A\. M\. Bastos et al\., “Canonical Microcircuits for Predictive Coding,”*Neuron*, vol\. 76, no\. 4, pp\. 695–711, 2012\.
- \[22\]K\. Friston et al\., “Active Inference: A Process Theory,”*Neural Comput\.*, vol\. 29, no\. 1, pp\. 1–49, 2017\.
- \[23\]M\. Seitzer et al\., “On the Pitfalls of Heteroscedastic Uncertainty Estimation with Probabilistic Neural Networks,” in*Proc\. ICLR*, 2022\.
- \[24\]D\. Krotov and J\. J\. Hopfield, “Dense Associative Memory for Pattern Recognition,” in*Proc\. NeurIPS*, 2016\.
- \[25\]H\. Ramsauer et al\., “Hopfield Networks is All You Need,” arXiv:2008\.02217, 2020\.
- \[26\]E\. van der Pol et al\., “Plannable Approximations to MDP Homomorphisms: Equivariance under Actions,” in*Proc\. AAMAS*, 2020\.
- \[27\]M\. Dresler et al\., “Dreamed movement elicits activation in the sensorimotor cortex,”*Curr\. Biol\.*, vol\. 21, no\. 21, pp\. 1833–1837, 2011\.
- \[28\]A\. Guillot et al\., “Imagining is not doing but involves specific motor commands,”*Front\. Hum\. Neurosci\.*, vol\. 6, p\. 247, 2012\.
- \[29\]F\. Briggs, “Role of feedback connections in central visual processing,”*Annu\. Rev\. Vision Sci\.*, vol\. 6, no\. 1, pp\. 313–334, 2020\.
- \[30\]J\. W\. Mink, “The Basal Ganglia: Focused Selection and Inhibition of Competing Motor Programs,”*Prog\. Neurobiol\.*, vol\. 50, no\. 4, pp\. 381–425, 1996\.
- \[31\]A\. Barreto et al\., “Successor Features for Transfer in Reinforcement Learning,” in*Proc\. NeurIPS*, 2017\.
- \[32\]P\. Dayan, “Improving Generalization for Temporal Difference Learning: The Successor Representation,”*Neural Comput\.*, vol\. 5, no\. 4, pp\. 613–624, 1993\.
- \[33\]J\. Schmidhuber, “A Possibility for Implementing Curiosity and Boredom in Model\-Building Neural Controllers,” in*Proc\. SAB*, pp\. 222–227, 1991\.
- \[34\]J\. Schmidhuber, “Formal Theory of Creativity, Fun, and Intrinsic Motivation \(1990–2010\),”*IEEE Trans\. Auton\. Ment\. Dev\.*, vol\. 2, no\. 3, pp\. 230–247, 2010\.
- \[35\]H\. Feldman and K\. J\. Friston, “Attention, Uncertainty, and Free\-Energy,”*Front\. Hum\. Neurosci\.*, vol\. 4, 215, 2010\.
- \[36\]G\. Alain and Y\. Bengio, “Understanding Intermediate Layers Using Linear Classifier Probes,” arXiv:1610\.01644, 2016\.
- \[37\]D\. Hafner et al\., “Dream to Control: Learning Behaviors by Latent Imagination,” in*Proc\. ICLR*, 2020\.
- \[38\]C\. Gan et al\., “ThreeDWorld: A Platform for Interactive Multi\-Modal Physical Simulation,” arXiv:2007\.04954, 2020\.
- \[39\]L\. Fan et al\., “MineDojo: Building Open\-Ended Embodied Agents with Internet\-Scale Knowledge,” in*Proc\. NeurIPS*, 2022\.
- \[40\]K\. Friston, “The Free\-Energy Principle: A Rough Guide to the Brain?”*Trends Cognit\. Sci\.*, vol\. 13, no\. 7, pp\. 293–301, 2009\.
- \[41\]R\. A\. Adams, K\. E\. Stephan, H\. R\. Brown, C\. D\. Frith, and K\. J\. Friston, “The Computational Anatomy of Psychosis,”*Front\. Psychiatry*, vol\. 4, art\. 47, 2013\.
- \[42\]C\. Mathys et al\., “A Bayesian Foundation for Individual Learning Under Uncertainty,”*Front\. Hum\. Neurosci\.*, vol\. 5, art\. 39, 2011\.

Similar Articles

Categorical AI phenomenology: A first-person approach

arXiv cs.AI

This paper develops a phenomenology-first approach to artificial consciousness by modeling subjective experience with categories derived from Q-networks, emphasizing enactive and embedded dimensions of computational systems.