Nine Emotion Centroids: A Label-Free Valence Axis That Transfers Across Four Modalities

arXiv cs.CL Papers

Summary

This paper introduces a label-free method to find a valence axis from nine emotion examples that transfers across text, vision, audio, and brain modalities, achieving competitive sentiment classification with minimal labels.

arXiv:2608.18090v1 Announce Type: new Abstract: Inside a modern language model sits a single internal direction that tracks how positive or negative a sentence feels. We show how to find this valence axis (V-axis) from just 9 emotion category names plus 50 short narrative paragraphs per emotion -- about 1,500 fewer labels than the usual supervised approach -- and that the same direction appears in vision, audio, and human-brain encoders never jointly trained. The recipe: embed nine emotion-anchored story sets in a frozen encoder, take the top principal direction of the nine averaged embeddings. Projecting new inputs onto it captures 93% of supervised performance on SST-2 (Llama-3-8B-Instruct, AUC 0.772 vs. 0.828), correlates with human valence ratings on 11,811 EmoSet images at r=0.636, reaches AUC 0.906 on ESC-50 audio (p<2.2e-15), and AUC 0.720+/-0.055 on EEG from 123 subjects (p<3.65e-8). The direction is mechanistically active: ablating it collapses sentiment accuracy by 5.5-37.2 pp across three LLMs vs. at most 0.88 pp for matched random directions (z>12). A 2-parameter classifier trained on text labels transfers to images (AUC 0.961), audio (0.764), and brain recordings (0.828) without target-modality labels; a generic 16-D subspace stays at chance (0.525). The recipe is bounded to continuous attributes -- seven tests on categorical concepts return near-chance -- and steering is family-specific (Llama/Mistral yes, Qwen/Gemma no).
Original Article
View Cached Full Text

Cached at: 08/20/26, 09:53 AM

# Nine Emotion Centroids: A Label-Free Valence Axis That Transfers Across Four Modalities
Source: [https://arxiv.org/html/2608.18090](https://arxiv.org/html/2608.18090)
###### Abstract

Inside a modern language model sits a single internal direction that tracks how positive or negative a sentence feels\. We show how to find this*valence axis*\(V\-axis\) from just99emotion category names plus∼50\\sim\\\!50short narrative paragraphs per emotion – about1,500×1\{,\}500\{\\times\}fewer labels than the usual supervised approach – and that the same direction shows up in vision, audio, and human\-brain encoders that were never jointly trained\. The recipe has three lines: write nine emotion\-anchored stories, embed each one in a frozen encoder, and take the top principal direction of the nine averaged embeddings\. That direction is the V\-axis\. Projecting new inputs onto it gives a sentiment score that matches a fully\-supervised classifier across four modalities: it captures93%93\\%of supervised performance on SST\-2 text sentiment \(Llama\-3\-8B\-Instruct, AUC0\.7720\.772vs\.0\.8280\.828\), correlates with human valence ratings on11,81111\{,\}811EmoSet images at Pearsonr=\+0\.636r\{=\}\{\+\}0\.636\(random\-direction null\|r\|≤0\.112\|r\|\\leq 0\.112\), reaches AUC0\.9060\.906on5050ESC\-50 audio categories \(pairedp=2\.2×10−15p\{=\}2\.2\{\\times\}10^\{\-15\}\), and AUC0\.720±0\.0550\.720\\pm 0\.055on EEG recorded from123123subjects watching emotional videos \(pooledp=3\.65×10−8p\{=\}3\.65\{\\times\}10^\{\-8\}\)\. The direction is not just predictive but mechanistically active: surgically removing it from a language model’s hidden state – the standard*directional ablation*technique ofArditiet al\.\([2024](https://arxiv.org/html/2608.18090#bib.bib4)\)– collapses sentiment classification by5\.55\.5–37\.237\.2percentage points across three models, while removing equally\-large random directions costs at most0\.880\.88percentage points \(signal is≥12\\geq 12standard deviations above the random null\)\. Because the same recipe produces an axis in every modality, a single sentiment classifier with two free parameters trained on text labels alone reads sentiment off images \(AUC0\.9610\.961\), audio \(0\.7640\.764\), and brain recordings \(0\.8280\.828\) without ever seeing target\-modality labels; a generic1616\-dimensional cross\-encoder “shared subspace” on the same task stays at chance \(0\.5250\.525\)\. The recipe is sharply bounded – seven independent tests on categorical concepts \(object class, word pairs, AxBench Concept\-500\(Wuet al\.,[2025](https://arxiv.org/html/2608.18090#bib.bib3)\)\) return at\-or\-near chance – and so is its causal usability: reasoning\-distilled models shift the axis to their last layer, and only Llama\- and Mistral\-family models can be*steered*by adding the V\-axis back to generation; Qwen and Gemma can be probed but not steered\. The takeaway is that valence is one of the rare attributes simple enough to recover with nine examples and shared enough across encoders to bridge text, images, sound, and brain activity through a single dimension\.

## 1Introduction

A modern language model, when it reads a sentence, builds up an internal pattern of activity across thousands of neurons that we call its*hidden state*\(or*residual stream*, since each transformer block adds to a running sum\)\. Recent interpretability work has found that surprisingly simple structure lives inside that activity\. In particular, many high\-level attributes that we might naively think of as scattered across the network – “is this sentence about France?”, “is the model about to refuse the request?”, “does this concept refer to a person?” – can in fact be read off, and sometimes manipulated, by looking at a*single linear direction*in the hidden\-state space\(Parket al\.,[2024](https://arxiv.org/html/2608.18090#bib.bib1); Arditiet al\.,[2024](https://arxiv.org/html/2608.18090#bib.bib4)\)\. We add one more attribute to that list:*valence*, the positive\-vs\-negative emotional charge of a piece of input\. We then show two things that, to our knowledge, no prior valence\-axis result has shown together: that the direction can be found with∼9\\sim\\\!9category names and∼450\\sim\\\!450unlabelled sentences instead of thousands of polarity labels, and that the*same*valence direction \(up to per\-modality refit of one direction\) appears in vision, audio, and human\-EEG encoders that share no pretraining whatsoever\.

### Standard route vs\. our recipe\.

The textbook way to build a continuous\-attribute axis inside a foundation model is supervised: take thousands of labelled examples \(positive sentences, negative sentences\), run them through the model, and fit a linear classifier on the hidden state\. The weight vector of that classifier is the “axis\.” Our recipe takes a different path\. It requires*no*polarity labels and only1818supervision events total:99emotion category names \(anger, joy, fear, …\) and99writing prompts\. From those we author∼50\\sim\\\!50short emotion\-evocative paragraphs per emotion, embed each one through a frozen encoder, average within emotion to get99*emotion centroids*in hidden\-state space, and take the top principal component \(PC1\) of the resulting9×d9\{\\times\}dmatrix\. That single direction – the V\-axis \(*valence axis*\) – is the only quantity used downstream\. The label\-cost ratio versus a supervised SST\-2 probe\(Socheret al\.,[2013](https://arxiv.org/html/2608.18090#bib.bib12)\)is∼1,546×\\sim\\\!1\{,\}546\{\\times\}\.

### What is genuinely new versus prior work\.

The construction is*PC1 ofK=9K\{=\}9category centroids*, not a discriminant between two contrastive labels: Park–Choe–Veitch\(Parket al\.,[2024](https://arxiv.org/html/2608.18090#bib.bib1)\)directions live in a pair\-discriminant geometry, and the V\-axis is orthogonal to those directions on identical concepts \(mean\|cos\|=0\.038\|\\cos\|\{=\}0\.038\)\. The directional\-ablation intervention ofArditiet al\.\([2024](https://arxiv.org/html/2608.18090#bib.bib4)\)is here applied to a*recipe\-derived*direction, not to a discriminant fit to refusal/sentiment labels, so the causal claim tests the recipe itself rather than reading off supervision\. And the four\-encoder cross\-modal transfer matrix, to our knowledge, has no precedent in the LRH–AxBench–steering line, which is text\-only\. The paper is organised as a probe→\\tomechanism→\\tocausal triad: probe \(§[3](https://arxiv.org/html/2608.18090#S3)\), mechanism \(§[7](https://arxiv.org/html/2608.18090#S7)\), causal \(§[4](https://arxiv.org/html/2608.18090#S4)\)\.

### Why nine and not two\.

Fitting a single “sentiment direction” to a pair of contrastive labels \(positive vs\. negative\) forces a sign and conflates valence \(pleasant/unpleasant\) with arousal \(calm/intense\)\. Spreading the centroids across nine Russell–Ekman emotion categories\(Russell,[1980](https://arxiv.org/html/2608.18090#bib.bib18); Ekman,[1992](https://arxiv.org/html/2608.18090#bib.bib19)\)lets the data decide along which direction the centroids spread the most; valence wins because it dominates emotion\-text variance\.

### Four supporting numbers, one per modality\.

We measure the V\-axis in four encoders that were trained on entirely different data and objectives\. For text, projecting Llama\-3\-8B\-Instruct’s hidden state at residual block2020onto the V\-axis classifies SST\-2 sentences at AUC0\.7720\.772, which is93%93\\%of the AUC \(0\.8280\.828\) of a supervised linear probe trained on6,9206\{,\}920SST\-2 labels\. The same construction on Qwen3\-8B reaches AUC0\.7870\.787, after a layer search that picks out block3131rather than the middle of the network – a depth shift specific to reasoning\-distilled models that we document in §[7](https://arxiv.org/html/2608.18090#S7)\. For*vision*, the V\-axis built from∼450\\sim\\\!450emotion\-correlated images on the CLIP\-image encoder\(Radfordet al\.,[2021](https://arxiv.org/html/2608.18090#bib.bib8)\)correlates with crowdworker valence ratings of11,81111\{,\}811EmoSet images\(Yanget al\.,[2023](https://arxiv.org/html/2608.18090#bib.bib9)\)at Pearsonr=\+0\.636r\{=\}\{\+\}0\.636\(random\-direction null\|r\|≤0\.112\|r\|\\leq 0\.112\)\. For*audio*, the V\-axis on the CLAP\-audio encoder\(Elizaldeet al\.,[2023](https://arxiv.org/html/2608.18090#bib.bib10)\)reaches mean AUC0\.9060\.906on the5050ESC\-50\(Piczak,[2015](https://arxiv.org/html/2608.18090#bib.bib11)\)environmental\-sound categories \(paired permutationp=2\.2×10−15p\{=\}2\.2\{\\times\}10^\{\-15\}\) – the strongest single\-modality result, plausibly because CLAP’s text\-audio contrastive objective makes emotion\-aligned text concepts directly probeable in audio\. For*EEG*– recordings of electrical brain activity made while subjects watched emotional videos\(Chenet al\.,[2023](https://arxiv.org/html/2608.18090#bib.bib13)\)– the V\-axis built from the CBraMod EEG foundation model\(Chenet al\.,[2024](https://arxiv.org/html/2608.18090#bib.bib14)\)reaches AUC0\.720±0\.0550\.720\\pm 0\.055across123123subjects \(pooledp=3\.65×10−8p\{=\}3\.65\{\\times\}10^\{\-8\}, subject\-stratified55\-fold split\)\.

### From a probe to a causal lever\.

A predictive direction may merely be*correlated*with the attribute; it does not necessarily*produce*the model’s sentiment behaviour\. To distinguish the two we use*directional ablation*\(Arditiet al\.,[2024](https://arxiv.org/html/2608.18090#bib.bib4)\): at every layer and token position during a forward pass, replace the hidden statehhwithh−\(⟨h,v⟩\)​vh\-\(\\langle h,v\\rangle\)v, wherevvis the unit V\-axis\. In words, we orthogonally project the V\-axis out of the running representation – the model is forced to think without it being available – and read off SST\-2 accuracy\. Across three independent LLMs the V\-axis ablation drops accuracy by5\.55\.5pp \(Llama\-3\-8B\-Inst\),15\.815\.8pp \(Qwen3\-1\.7B\), and37\.237\.2pp \(Qwen3\-8B at block2323\), while three matched\-magnitude random directions per model cost at most0\.880\.88pp under the identical protocol\. The signal is≥12\\geq 12standard deviations above the random null in every model and196​σ196\\sigmain Qwen3\-8B\. Random directions touch random features; the V\-axis touches sentiment\.

### One classifier, four modalities\.

A V\-axis exists separately in each encoder, but the sentiment*classifier*on top of one V\-axis does not need re\-training when moved to another modality\. We fit a22\-parameter logistic regression on SST\-2 text scores against text labels, then evaluate it on each other modality’s V\-axis projections – with no target\-modality labels at the head\-fitting stage\. All12/1212/12off\-diagonal cells of the resulting4×44\{\\times\}4matrix exceed AUC0\.700\.70; text\-trained reaches0\.9610\.961on EmoSet,0\.7640\.764on ESC\-50,0\.8280\.828on EEG\. A natural baseline – the generic top\-1616shared subspace between the same encoders, computed without reference to sentiment – is at chance \(0\.5250\.525\)\. One task\-relevant dimension beats sixteen generic dimensions by0\.180\.18–0\.440\.44AUC\.

### Why this is not a re\-skin of AxBench\.

AxBench\(Wuet al\.,[2025](https://arxiv.org/html/2608.18090#bib.bib3)\)showed supervised linear probes outperform sparse autoencoders for LLM steering, using100100–1,0001\{,\}000labels per concept on text\-only categorical concepts\. We push on all three of those axes simultaneously: the label budget drops to1818events \(≥50×\\geq\\\!50\{\\times\}less\); the concept is continuous, not categorical – crucially, applying our recipe to AxBench’s own500500categorical concepts returns at\-or\-near chance \(KSp=0\.41p\{=\}0\.41, App\.[F](https://arxiv.org/html/2608.18090#A6)\); and the modality scope extends to vision, audio, and EEG, where a genericK=16K\{=\}16shared subspace is at chance for sentiment \(0\.5250\.525\)\.

### Contributions\.

\(i\)The recipe\(§[2](https://arxiv.org/html/2608.18090#S2)\): nine emotion centroids, SVD, take PC1, fully specified for reproduction\. \(ii\)Four\-modality probe\(§[3](https://arxiv.org/html/2608.18090#S3)\): the same recipe matches supervised classifiers within77pp AUC in text,r=\+0\.636r\{=\}\{\+\}0\.636in vision,0\.9060\.906AUC in audio,0\.7200\.720AUC in EEG\. \(iii\)Causal evidence\(§[4](https://arxiv.org/html/2608.18090#S4)\): inference\-time projection drops sentiment by5\.55\.5–37\.237\.2pp vs\.≤0\.88\\leq 0\.88pp for matched random directions \(z≥12​σz\\geq 12\\sigma\)\. \(iv\)Universal cross\-modal classifier\(§[5](https://arxiv.org/html/2608.18090#S5)\): one text\-supervised head transfers to four encoders with12/1212/12cross\-cells AUC≥0\.70\\geq 0\.70\. \(v\)Scope statements\(§[6](https://arxiv.org/html/2608.18090#S6)\): seven categorical\-concept failures, a reasoning\-distillation depth shift, and a family\-specific steering pattern \(Llama, Mistral yes; Qwen, Gemma no\)\.

### What this is not\.

The recipe is an*empirical regularity*, not an analytical theorem\. It is bounded to*continuous*concepts: seven independent tests on categorical concepts \(Park–Choe–Veitch word pairs\(Parket al\.,[2024](https://arxiv.org/html/2608.18090#bib.bib1)\); long\-tail retrieval; multi\-concept probes; AxBench Concept\-500\(Wuet al\.,[2025](https://arxiv.org/html/2608.18090#bib.bib3)\); vision CIFAR\-100; categorical concepts at all five depth slices; depth\-shift specificity\) return at\-or\-near chance\. The EEG V\-axis itself is built from a supervised linear discriminant on FACED valence labels; the “label\-free” part of the EEG result is the head, not the axis\. The text–image–audio V\-axes are unsupervised\. “Universal” in the cross\-modal\-classifier claim is scoped to the four encoders we tested–CLIP\-text\(Radfordet al\.,[2021](https://arxiv.org/html/2608.18090#bib.bib8)\), CLIP\-image, CLAP\-audio\(Elizaldeet al\.,[2023](https://arxiv.org/html/2608.18090#bib.bib10)\), CBraMod\-EEG\(Chenet al\.,[2024](https://arxiv.org/html/2608.18090#bib.bib14)\)–not to encoders not yet tested\. Directional ablation is sign\-insensitive, so no sign\-flip search is run for the causal panel; we describe the identification protocol in §[4](https://arxiv.org/html/2608.18090#S4)and treat “causal” as inference\-time\-projection evidence, not counterfactual\-intervention evidence\.

### Relation to recent work\.

AxBench\(Wuet al\.,[2025](https://arxiv.org/html/2608.18090#bib.bib3)\)reports that simple supervised linear\-probe baselines steer LLMs better than sparse autoencoders\. Our recipe differs on three quantitative axes:*label budget*\(n=18n\{=\}18supervision events here, vs\.∼100\\sim\\\!100–1,0001\{,\}000examples per concept in AxBench,≥50×\\geq\\\!50\{\\times\}less\);*concept type*\(we target continuous valence; on AxBench’s500500categorical concepts the recipe ties the matched\-norm null, KSp=0\.41p\{=\}0\.41, Appendix[F](https://arxiv.org/html/2608.18090#A6)\); and*modality scope*\(text only in AxBench; here we add three independent encoders without retraining the head\)\. The Linear Representation Hypothesis\(Parket al\.,[2024](https://arxiv.org/html/2608.18090#bib.bib1)\)identifies concept\-discriminant directions for categorical attributes; the V\-axis is continuous\-attribute and is approximately orthogonal to Park–Choe–Veitch causal\-inner\-product directions \(mean\|cos\|=0\.038\|\\cos\|\{=\}0\.038\)\. The Platonic Representation Hypothesis\(Huhet al\.,[2024](https://arxiv.org/html/2608.18090#bib.bib6)\)predicts cross\-encoder convergence on ImageNet\-class similarity; our4×44\{\\times\}4matrix extends this to a single task\-relevant 1\-D direction across modalities that share no pretraining, including EEG\.

## 2The Recipe

### Intuition\.

Write nine short stories, one each for anger, disgust, fear, sadness, amusement, joy, inspiration, tenderness, and a neutral baseline – about fifty stories per category\. Run them through a frozen language model and look at its hidden state on the final token of each story\. Average within each category\. You now have nine vectors, one per emotion, that act as “coordinates” for that emotion in the model’s representation space\. Find the single direction along which those nine points spread the most \(principal component analysis\)\. That direction is the V\-axis\. The rest of the paper just measures what it does\.

The construction is identical across modalities up to the encoder\. We describe the language\-model version first, then state the per\-modality changes\.

### Step 1: emotion centroids\.

We use the nine FACED emotion categories \(*anger, disgust, fear, sadness, amusement, joy, inspiration, tenderness, neutral*\) as concept anchors\. For each emotionc∈\{1,…,9\}c\\in\\\{1,\\dots,9\\\}, we authorNc≈50N\_\{c\}\\\!\\approx\\\!50narrative sentences describing situations that elicit emotioncc\(*e\.g\.*, “After a long day, the sun finally broke through the clouds and warmed her face”\)\. Sentences are paragraph\-length \(≥15\\geq 15tokens\) and emotion\-anchored but otherwise unconstrained in topic; we do not curate for sentiment polarity, syntactic structure, or domain\. The full prompt set is in Appendix[A](https://arxiv.org/html/2608.18090#A1); total label budget is 9 emotion words plus 9 paragraph\-writing prompts \(n=18n\{=\}18supervision events, total\)\.

### Step 2: encode and pool\.

For each sentencesc,is\_\{c,i\}we run a forward pass through a frozen encoderfθf\_\{\\theta\}and read off the residual\-stream activation at a fixed layerℓ\\elland final\-token position\. We then take the centroid per emotion:μc=1Nc​∑i=1Ncfθ\(ℓ\)​\(sc,i\)\\mu\_\{c\}=\\tfrac\{1\}\{N\_\{c\}\}\\sum\_\{i=1\}^\{N\_\{c\}\}f\_\{\\theta\}^\{\(\\ell\)\}\(s\_\{c,i\}\), yieldingM∈ℝ9×dM\\in\\mathbb\{R\}^\{9\\times d\}\.

### Step 3: SVD\.

CenterMMacross the nine emotion rows, compute the SVDM−μ¯=U​Σ​V⊤M\-\\bar\{\\mu\}=U\\Sigma V^\{\\top\}, and take the right\-singular vectorv1∈ℝdv\_\{1\}\\in\\mathbb\{R\}^\{d\}corresponding to the top singular value\. We callv1v\_\{1\}the*V\-axis*\. All downstream scoring is the scalar projection⟨x,v1⟩\\langle x,v\_\{1\}\\ranglefor new inputsxx\.

The recipe is summarised in Algorithm[1](https://arxiv.org/html/2608.18090#algorithm1)\. It uses no concept labels \(the only “supervision” is the 9 emotion category names used to assign sentences to centroids\); it uses one forward pass per sentence \(9×50=4509\\times 50=450passes total\); and it produces a 1\-D direction\.

Algorithm 1V\-axis constructionInput:encoderfθf\_\{\\theta\}, layerℓ\\ell; 9 emotion category names\{c\}\\\{c\\\}; per\-emotion sentence pools\{sc,i\}i=1Nc\\\{s\_\{c,i\}\\\}\_\{i=1\}^\{N\_\{c\}\}\(Nc≈50N\_\{c\}\\\!\\approx\\\!50\)\. Output:V\-axisv1∈ℝdv\_\{1\}\\in\\mathbb\{R\}^\{d\}\.

1. 1\.For eachc,ic,i: computehc,i=fθ\(ℓ\)​\(sc,i\)h\_\{c,i\}=f\_\{\\theta\}^\{\(\\ell\)\}\(s\_\{c,i\}\)\(residual stream, final token\)\.
2. 2\.Compute centroidsμc=1Nc​∑ihc,i\\mu\_\{c\}=\\tfrac\{1\}\{N\_\{c\}\}\\sum\_\{i\}h\_\{c,i\}; stack asM∈ℝ9×dM\\in\\mathbb\{R\}^\{9\\times d\}\.
3. 3\.Center:M~=M−19​∑cμc\\tilde\{M\}=M\-\\tfrac\{1\}\{9\}\\sum\_\{c\}\\mu\_\{c\}\.
4. 4\.SVD:M~=U​Σ​V⊤\\tilde\{M\}=U\\Sigma V^\{\\top\}; returnv1=V:,1v\_\{1\}=V\_\{:,1\}\.

### Per\-modality changes\.

For image \(CLIP\-image\), audio \(CLAP\-audio\), and EEG \(CBraMod\), sentences are replaced by the modality\-native object: video clips for EEG,∼50\\sim\\\!50class\-correlated images per emotion from EmoSet for vision, and∼50\\sim\\\!50class\-correlated clips per emotion from ESC\-50 for audio\. The pooling layerℓ\\ellis fixed to the encoder’s standard penultimate residual layer in all three non\-LLM cases\. The EEG axis is built differently: the unsupervised PC1 of the 9 FACED\-class centroids picks up an arousal\-like direction \(joy and fear both project positive\)\. We instead fit a Fisher linear discriminant on binary FACED\-valence labels in CBraMod feature space; this is the only modality where the axis itself uses task supervision \(see §[6](https://arxiv.org/html/2608.18090#S6)\)\.

### Choice of layer\.

For instruction\-tuned and base LLMs in the Llama, Mistral, and Qwen3 families, mid\-depth \(ℓ≈L/2\\ell\\approx L/2\) is optimal\. For reasoning\-distilled LLMs \(DeepSeek\-R1\-Distill, Qwen3\-thinking\), the V\-axis is suppressed at mid\-depth and recovers near the last layer; we document this depth shift in §[7](https://arxiv.org/html/2608.18090#S7)\. Choice ofℓ\\ellrequires depth search on the model family; we report the search procedure in Appendix[B](https://arxiv.org/html/2608.18090#A2)\.

### What does*not*work\.

Using the 9 emotion words themselves as the sentence pool \(*i\.e\.*,Nc=1N\_\{c\}\{=\}1\) collapses the recipe: the 9\-word V\-axis on Llama\-3 reaches AUC0\.500\.50on SST\-2 \(random\)\. The recipe needs paragraph\-length per\-emotion text\. The transition to non\-trivial AUC requires roughlyNc≥20N\_\{c\}\\geq 20; we report the fullNcN\_\{c\}sweep in Appendix[C](https://arxiv.org/html/2608.18090#A3)\.

## 3Four Modalities

The same recipe applied to four independently\-trained foundation encoders recovers a 1\-D direction that tracks valence at the level of supervised classifiers \(Table[1](https://arxiv.org/html/2608.18090#S3.T1); per\-modality bar visualisation deferred to Appendix[I](https://arxiv.org/html/2608.18090#A9)\)\.

Table 1:V\-axis \(label\-free for text/image/audio, supervised\-in\-axis for EEG\) recovers supervised\-classifier valence within77pp AUC across four modalities\.*Recipe AUC*: held\-out AUC ofσ​\(⟨x,v1⟩\)\\sigma\(\\langle x,v\_\{1\}\\rangle\)wherev1v\_\{1\}is the V\-axis \(text Pearsonrrfor vision\)\.*Sup\. AUC*: a logistic\-regression head trained on the modality’s full label set \(nSST\-2=6,920n\_\{\\text\{SST\-2\}\}\{=\}6\{,\}920;nEmoSet=11,811n\_\{\\text\{EmoSet\}\}\{=\}11\{,\}811;nESC\-50=2,000n\_\{\\text\{ESC\-50\}\}\{=\}2\{,\}000;nFACED=123n\_\{\\text\{FACED\}\}\{=\}123subjects\)\.*Ratio*: recipe//supervised\. See §[3](https://arxiv.org/html/2608.18090#S3)\.### Text\.

Two LLMs, two layer regimes\. Llama\-3\-8B\-Instruct at residual block2020\(depth0\.670\.67, near mid\-depth\) reaches AUC0\.7720\.772on SST\-2 against a0\.8280\.828supervised head trained on6,9206\{,\}920binary\-sentiment labels; the recipe uses 9 prompts \(450 sentences total\), giving a label\-cost ratio of≈1,546×\\approx\\\!1\{,\}546\{\\times\}\. Qwen3\-8B, after a sweep overℓ∈\{14,20,24,27,31\}\\ell\\in\\\{14,20,24,27,31\\\}, peaks atℓ=31\\ell\{=\}31\(depth0\.860\.86, near the last layer\) with AUC0\.7870\.787; the same model atℓ=L/2\\ell\{=\}L/2is at chance\. The depth shift is reasoning\-distillation\-specific \(§[7](https://arxiv.org/html/2608.18090#S7)\)\.

### Vision\.

EmoSet\(Yanget al\.,[2023](https://arxiv.org/html/2608.18090#bib.bib9)\)provides crowdworker valence ratings for118,000118\{,\}000emotion\-tagged images\. We build the visual V\-axis from∼50\\sim\\\!50class\-correlated images per emotion \(*e\.g\.*, “contented dog” for tenderness, “decomposing fruit” for disgust\) and project the EmoSet test split ontov1v\_\{1\}\. Pearsonr=\+0\.636r\{=\}\{\+\}0\.636on the held\-out split \(two\-sidedp<10−50p<10^\{\-50\}\); the permutation null over1,0001\{,\}000random direction draws has\|r\|≤0\.112\|r\|\\leq 0\.112\.

### Audio\.

ESC\-50 has 50 environmental\-sound categories with hand\-curated emotional valence labels\. The CLAP\-audio V\-axis reaches mean AUC0\.9060\.906across 50 binary one\-vs\-rest splits, with paired\-permutationp=2\.2×10−15p=2\.2\\\!\\times\\\!10^\{\-15\}\(per\-class breakdown in Appendix[G](https://arxiv.org/html/2608.18090#A7)\)\. This is the strongest single\-modality V\-axis we obtain; we attribute the strength to CLAP’s contrastive natural\-language objective, which makes emotion\-aligned text concepts directly probeable in the audio encoder\.

### EEG \(scope: supervised\-in\-axis, label\-free at the bridge\)\.

FACED\(Chenet al\.,[2023](https://arxiv.org/html/2608.18090#bib.bib13)\)contains123123subjects watching 28 emotion\-evoking video clips with 9\-way labels\. We encode 30\-second windows through CBraMod\(Chenet al\.,[2024](https://arxiv.org/html/2608.18090#bib.bib14)\), fit a binary\-valence LDA in 200\-D feature space, and use the LDA weight as the V\-axis\. Across 5 random subject\-stratified splits \(subjects 100–122 held out, 23 held\-out subjects\), AUC=0\.720±0\.055=0\.720\\pm 0\.055, pooledp=3\.65×10−8p=3\.65\\\!\\times\\\!10^\{\-8\}\.*This axis is supervised*: the unsupervised 9\-class PC1 reaches only0\.5120\.512on EEG because joy and fear both project positive \(an arousal\-like direction\)\. The scope claim is therefore narrow and explicit: three of the four V\-axes \(text, image, audio\) are label\-free in the axis; the EEG axis is not\. The cross\-modal headline “text→\\toEEG AUC0\.8280\.828” refers to the*bridge*: a11\-D logistic head trained on SST\-2 text labels and applied to per\-subject CBraMod activations projected onto the EEG V\-axis, with no FACED labels at the head\-fitting stage\. The EEG bound in this paper is a bound on the axis alignment, not on the cross\-modal classifier\. Dropping EEG entirely was considered but would understate cross\-encoder convergence; the salvage is documented in Appendix[H](https://arxiv.org/html/2608.18090#A8)\.

### Cross\-modal alignment\.

The four V\-axes are not literally the same vector–they live in different encoder spaces with no shared coordinates\. To test whether they are nonetheless statistically aligned, we apply Pang\-calibrated CKA atK=200K\{=\}200between every pair of V\-axis projections\(Pang and others,[2026](https://arxiv.org/html/2608.18090#bib.bib7)\)\. All three text↔\\leftrightarrowimage↔\\leftrightarrowaudio pairs reject the matched\-norm null \(p≤0\.032p\\leq 0\.032\)\. The alignment is small\-magnitude but reliably above chance; we view this as evidence that the four V\-axes carry partially\-shared structure, while leaving open whether full directional correspondence holds under a stricter geometry\.

## 4Causal Evidence

### Intuition\.

Imagine reaching into the model mid\-thought and surgically deleting the V\-axis from its working memory at every step of the forward pass – then asking it to classify sentiment\. If the V\-axis is merely correlated with sentiment, the model has redundant features and barely notices\. If the V\-axis carries sentiment, removal should hurt\. To rule out that any large\-magnitude perturbation hurts, we also delete three random directions of identical size as a control\. Random directions cost almost nothing; the V\-axis costs55–3737percentage points of accuracy\. That gap is the evidence that the V\-axis is not merely riding alongside sentiment but doing the work\.

### Protocol\.

We follow the directional\-ablation protocol ofArditiet al\.\([2024](https://arxiv.org/html/2608.18090#bib.bib4)\), which projects a target direction out of the residual stream at every layer, every token position, during a forward pass\. Concretely, at each layerℓ\\ellwe replace the residual streamht\(ℓ\)h^\{\(\\ell\)\}\_\{t\}at every token positionttwithht\(ℓ\)−\(⟨ht\(ℓ\),v^1⟩\)​v^1h^\{\(\\ell\)\}\_\{t\}\-\(\\langle h^\{\(\\ell\)\}\_\{t\},\\hat\{v\}\_\{1\}\\rangle\)\\hat\{v\}\_\{1\}, wherev^1\\hat\{v\}\_\{1\}is the unit V\-axis\. The forward pass otherwise runs as usual; we then read off SST\-2 sentiment classification accuracy from a logistic\-regression head trained on the unaltered model’s pooled activations at the hooked layer \(ntrain=2,000n\_\{\\text\{train\}\}\{=\}2\{,\}000,nval=872n\_\{\\text\{val\}\}\{=\}872\)\. We use the V\-axis built at the model’s optimal layer \(Llama\-3\-8B\-Instruct block 20; Qwen3\-1\.7B block 18; Qwen3\-8B block 23\)\. We compare to the same protocol withK=3K\{=\}3random directions of equal norm sampled isotropically from the residual\-stream Gaussian \(one matched draw per seed\)\.

### Identification \(no sign\-flip search\)\.

The ablation operationh−\(⟨h,v^1⟩\)​v^1h\-\(\\langle h,\\hat\{v\}\_\{1\}\\rangle\)\\hat\{v\}\_\{1\}is sign\-insensitive: projecting out\+v^1\+\\hat\{v\}\_\{1\}and−v^1\-\\hat\{v\}\_\{1\}remove the same subspace by construction\. The V\-axis is fixed once per model from the recipe of §[2](https://arxiv.org/html/2608.18090#S2), and the only number we report in Table[2](https://arxiv.org/html/2608.18090#S4.T2)is the drop from ablating exactly that direction; we do not search over±v1\\pm v\_\{1\}or over a neighbourhood ofv1v\_\{1\}\. The random\-direction null is matched in norm and sampled before evaluation, so thezz\-scores are unconditional\. The protocol therefore rules out a sign\-flip search as a source of the effect\. \(For sign\-fixing in the universal classifier, §[5](https://arxiv.org/html/2608.18090#S5), sign is fixed per modality from the source\-modality positive class once per row, with no search over off\-diagonal cells\.\)

Table 2:V\-axis directional ablation drops SST\-2 sentiment classification by5\.55\.5–37\.237\.2percentage points across three LLMs \(≥12​σ\\geq 12\\sigmaabove matched\-norm null in every row\)\. Columns:*Base/V\-abl\.*: SST\-2 dev\-split accuracy \(%\) without/with V\-axis projection ablation\.*Drop \(V\)*: V\-ablation accuracy−\-baseline accuracy \(pp\)\.*Random*: mean±\\pmstd drop overK=3K\{=\}3matched\-norm random\-direction draws\.z=\|Drop\(V\)\|/σRandomz\{=\}\|\\text\{Drop\(V\)\}\|/\\sigma\_\{\\text\{Random\}\}\.nval=872n\_\{\\text\{val\}\}\{=\}872\. Source:experiments/d31\_causal\_mediation/results/\. See §[4](https://arxiv.org/html/2608.18090#S4)\.![Refer to caption](https://arxiv.org/html/2608.18090v1/x1.png)Figure 1:V\-axis ablation degrades sentiment readout in three LLMs; matched\-norm random\-direction ablation does not\. Bars: drop in SST\-2 dev accuracy \(pp\) from inference\-time projection out of the residual stream of the V\-axis \(dark\) vs\.K=3K\{=\}3matched\-norm random directions \(light, error bar = std\)\. Annotation: drop in pp\.zzis\|V\-drop\|/σrandom\|\\text\{V\-drop\}\|/\\sigma\_\{\\text\{random\}\}\. Each panel uses the model’s sentiment\-optimal block; Qwen3\-8B uses block 23 \(depth0\.860\.86\), consistent with the reasoning\-distillation depth shift \(§[7](https://arxiv.org/html/2608.18090#S7)\)\.
### Result\.

Table[2](https://arxiv.org/html/2608.18090#S4.T2)and Figure[1](https://arxiv.org/html/2608.18090#S4.F1)report the full ablation panel\. The V\-axis drop is≥12​σ\\geq\\\!12\\sigmaabove the matched\-norm random\-direction null in every row, and reaches196​σ196\\sigmaon Qwen3\-8B\. The Qwen3\-8B drop \(−37\.2\-37\.2pp at block2323\) is the strongest causal signal we obtain and is consistent with the depth\-shift mechanism \(§[7](https://arxiv.org/html/2608.18090#S7)\): the V\-axis is concentrated in the last few layers of reasoning\-distilled models, so removing it leaves no redundant earlier copy\.

### Why trust the causal claim?

Four properties, taken together, distinguish the V\-axis effect from a generic representational perturbation\. \(i\) The matched\-norm random null gives≤0\.88\\leq 0\.88pp drop on every model, vs\.5\.55\.5–37\.237\.2pp for the V\-axis \(z≥12​σz\\geq 12\\sigma\)\. \(ii\) The intervention is directional: we project the V\-axis out of the residual stream, not perturb the model isotropically; the operation is sign\-insensitive \(\+v^1\+\\hat\{v\}\_\{1\}and−v^1\-\\hat\{v\}\_\{1\}remove the same subspace\), so no sign\-flip search inflates the effect\. \(iii\) The same recipe replicates the effect on three independent LLMs across two families \(Llama, Qwen\), at three different sentiment\-optimal layers\. \(iv\) The axis itself was fitted from99emotion centroids*without*SST\-2 supervision, so the SST\-2 readout used for evaluation never entered the V\-axis construction\. We follow the literature in calling Arditi\-style projection “causal,” but the appropriate scope statement is narrower: this is*evidence about a representational direction at inference time*, not a counterfactual intervention on a circuit\. We do not claim the V\-axis is the unique cause of sentiment classification, only that it is a feature whose removal causally degrades the readout\.Viget al\.\([2020](https://arxiv.org/html/2608.18090#bib.bib17)\)formalise the broader counterfactual\-mediation framework; our results are consistent with the V\-axis acting as a mediator but do not isolate one\.

### What this rules out\.

A skeptic might worry that projecting out*any*feature of comparable norm degrades the model’s representations enough to harm classification\. The matched\-norm random\-direction null answers this directly: random directions of equal norm, ablated identically, drop accuracy by at most0\.880\.88pp on any of the three models\. Random directions touch random features; the V\-axis touches sentiment\.

### Steering vs\. ablation: the family\-specific pattern\.

Removing the V\-axis from the forward pass and*adding*a scaled multiple of it back to steer generation are different operations\. Steering produces a usable causal effect on Llama and Mistral families \(Spearmanρ\\rhobetween V\-axis steering coefficient and downstream sentiment polarity reaches0\.450\.45for Mistral\-7B\-Instruct,0\.440\.44for Mistral\-7B\-base, and0\.370\.37for Llama\-3\-8B\-Instruct\), but is at chance on Qwen and Gemma families \(all\|ρ\|<0\.05\|\\rho\|<0\.05, none significant\)\. The base\-vs\-instruct stage does not predict steerability \(Mistral\-7B\-base steers as well as Mistral\-7B\-Inst\); the family does\. We treat this as evidence that the V\-axis is recoverable as a probe across all four families but is causally usable for steering only in two; the failure mode is family\-specific pretraining, not instruction tuning\. Full steering panel and 8\-model breakdown appear in Appendix[D](https://arxiv.org/html/2608.18090#A4)\.

## 5A Universal Cross\-Modal Classifier

### Intuition\.

One sentiment dial – a single threshold and slope – trained on text labels alone reads sentiment off images, sounds, and brain recordings\. The dial does not need to know what modality it is looking at; the V\-axis already does the modality\-specific work of projecting raw activations down to a11\-D valence score, and the dial just calibrates it into a probability\. The result is a sentiment classifier that crosses modality boundaries without ever seeing target\-modality labels: a22\-parameter logistic head trained on SST\-2 transfers across all four modalities with AUC≥0\.70\\geq 0\.70in12/1212/12off\-diagonal cells, including text→\\toEEG \(Figure[2](https://arxiv.org/html/2608.18090#S5.F2)\)\.

![Refer to caption](https://arxiv.org/html/2608.18090v1/x2.png)Figure 2:All12/1212/12cross\-modal cells transfer at AUC≥0\.70\\geq 0\.70\. Rows:*source*modality on which the 2\-parameter logistic head was fitted \(binary valence labels\)\. Columns:*target*modality evaluated\. Diagonal: 5\-fold self\-CV \(ntext=8,872n\_\{\\text\{text\}\}\{=\}8\{,\}872;nimage=5,905n\_\{\\text\{image\}\}\{=\}5\{,\}905;naudio=1,040n\_\{\\text\{audio\}\}\{=\}1\{,\}040;nEEG=1,725n\_\{\\text\{EEG\}\}\{=\}1\{,\}725\)\. Off\-diagonal: cross\-modal,nsource∈\{728,1034,4133,8000\}n\_\{\\text\{source\}\}\{\\in\}\\\{728,1034,4133,8000\\\}, no target labels at the head\-fitting stage\. See §[5](https://arxiv.org/html/2608.18090#S5)\.
### Setup\.

For each modalitym∈\{text, image, audio, EEG\}m\\in\\\{\\text\{text, image, audio, EEG\}\\\}we project a held\-out set onto the modality’s V\-axisv1\(m\)v\_\{1\}^\{\(m\)\}, producing a 1\-D real\-valued score per sample\. We then train a logistic regression on the source\-modality scores against source\-modality binary\-valence labels, and evaluate it on the target\-modality scores against target\-modality binary\-valence labels\. The head has two parameters \(slope, intercept\)\. The full4×44\\times 4transfer matrix is reported in Table[3](https://arxiv.org/html/2608.18090#S5.T3); diagonal entries use 5\-fold CV on the same modality, off\-diagonals are train\-source / test\-target\.

### Sign identification\.

The unsupervised V\-axis sign is unidentified by SVD\. We resolve sign per modality by aligning the V\-axis with the source\-modality positive class \(*i\.e\.*, fix sign so source\-positive\>\>source\-negative on average\)\. After per\-modality sign\-fixing, the4×44\\times 4matrix is computed without further sign search\.

Table 3:4×44\{\\times\}4V\-axis cross\-modal AUC matrix; all12/1212/12off\-diagonal cells≥0\.70\\geq 0\.70\. Each entry: held\-out AUC of a 2\-parameter logistic regression trained on*source*modality V\-axis projections \(binary valence\) and evaluated on*target*modality projections\. Diagonal: 5\-fold CV self\-AUC\. Off\-diagonal: cross\-modal transfer with no target\-modality labels at the head\-fitting stage; sign per modality is fixed once from the source positive class \(no off\-diagonal sign search\)\. Random\-direction baselines per off\-diagonal cell are0\.520\.52–0\.590\.59\. See §[5](https://arxiv.org/html/2608.18090#S5)\.
### Headline\.

A sentiment classifier trained on SST\-2 text labels achieves AUC0\.9610\.961on EmoSet images,0\.7640\.764on ESC\-50 audio, and0\.8280\.828on FACED EEG–without using any target\-modality labels at the head\-fitting stage\. The same head transfers symmetrically: image\-trained transfers to text at AUC0\.7250\.725, audio at0\.7640\.764, EEG at0\.8280\.828\. The transfer is robust to source choice; what changes between rows is only the modality on which the source\-modality LR was fit\.

### Why does 1 dimension work where 16 fail?

A natural baseline is to align the four modalities through a generic representational substrate–the top\-KKshared dimensions across encoders, computed without reference to any task\. Recent work\(Huhet al\.,[2024](https://arxiv.org/html/2608.18090#bib.bib6)\)suggestsK∈\[16,200\]K\\in\[16,200\]captures cross\-encoder agreement on object\-identity tasks\. We compare three setups \(Table[4](https://arxiv.org/html/2608.18090#S5.T4)\): genericK=16K\{=\}16substrate within shared encoder family;K=16K\{=\}16random subspace; raw 768\-D CLIP\. The V\-axis \(1\-D, sentiment\-specific\) outperforms all three by0\.180\.18–0\.440\.44AUC on text→\\toimage SST\-2→\\toEmoSet transfer\.

Table 4:One sentiment\-specific dimension beats1616generic dimensions by0\.180\.18–0\.440\.44AUC for cross\-modal sentiment transfer\. All entries: held\-out AUC of an SST\-2\-trained classifier evaluated on EmoSet image valence \(ntest=1,772n\_\{\\text\{test\}\}\{=\}1\{,\}772\)\. The bridge in each row replaces the V\-axis with the listed substrate\. See §[5](https://arxiv.org/html/2608.18090#S5)\.The interpretation:K=16K\{=\}16generic substrate captures*what encoders agree on*, which on natural images and text turns out to be object\-identity statistics, not affect\. The V\-axis is a single*task\-relevant*direction; one task\-relevant dimension dominates sixteen generic dimensions for cross\-modal sentiment transfer\.

### What this rules out\.

Two failure modes are explicitly ruled out by Table[4](https://arxiv.org/html/2608.18090#S5.T4): \(1\) cross\-encoder representational agreement is not, by itself, sufficient for cross\-modal classifier transfer \(the substrate\-only AUC is at chance\); \(2\) high\-dimensional text\-encoder features alone are not sufficient \(raw CLIP\-text0\.7710\.771is well below V\-axis0\.9610\.961\)\. The V\-axis works because it is built from a continuous\-attribute concept \(valence\) using the same per\-modality recipe; the cross\-modal alignment is in the*direction the recipe selects*, not in the raw feature spaces\.

### The EEG salvage\.

The unsupervised99\-class PC1 V\-axis on EEG is at chance \(0\.5120\.512self\-AUC\), because joy and fear both project positive \(an arousal\-like direction\)\. Replacing the unsupervised axis with a supervised binary\-valence LDA on FACED labels raises self\-AUC to0\.8670\.867and fills in the cross\-modal cells\. “Text→\\toEEG AUC0\.8280\.828without neural\-data labels” refers to the*classifier head*being label\-free for EEG, not the axis\. A fully label\-free EEG axis would require stimulus\-tagged EEG; we leave this to future work\.

### Cross\-encoder\-family scope\.

The four encoders share no pretraining: CLIP\-text and CLIP\-image are jointly contrastively trained but on object\-class supervision \(no affect labels\); CLAP\-audio and CBraMod are independently trained, the latter with no language exposure\. The shared structure that makes the V\-axis transfer is therefore not a contrastive\-CLIP artefact but a property of valence being approximately recoverable in each encoder’s residual stream\.

## 6What This Is Not

The recipe is bounded\. Seven independent tests on categorical concepts return at\-or\-near chance against the same99\-emotion pipeline, bounding it to continuous attributes: \(1\) Park–Choe–Veitch causal\-inner\-product directions for∼100\\sim\\\!100binary categorical concepts are approximately orthogonal to the V\-axis \(mean\|cos\|=0\.038\|\\cos\|\{=\}0\.038\); \(2\) long\-tail visual retrieval \(CuPL\) yields−0\.84\-0\.84pp R@10 vs\. supervised baseline; \(3\) recipe applied to55concept axes jointly reaches AUC0\.520\.52vs\. per\-axis\-supervised0\.780\.78; \(4\) a single “concept axis” across55random categorical concepts has PC1 explaining94%94\\%of the matched\-null PC1 variance; \(5\)99CIFAR\-100 superclass centroids in CLIP\-image space yield a PC1 that does not separate superclasses \(p=0\.41p\{=\}0\.41\); \(6\) AxBench Concept\-500\(Wuet al\.,[2025](https://arxiv.org/html/2608.18090#bib.bib3)\)ties the matched\-norm null \(KSp=0\.41p\{=\}0\.41, App\.[F](https://arxiv.org/html/2608.18090#A6)\); \(7\) categorical concepts in reasoning\-distilled LLMs show no depth shift \(App\.[E](https://arxiv.org/html/2608.18090#A5)\)\. The recipe also collapses when the per\-emotion pool is too small:99single\-word labels yield AUC0\.500\.50; the transition to non\-trivial AUC requiresNc≥20N\_\{c\}\\geq 20paragraph\-length continuations per emotion \(App\.[C](https://arxiv.org/html/2608.18090#A3)\)\.

Steering capacity is family\-specific\. Llama and Mistral produce a usable causal V\-axis for steering \(ρ∈\[0\.32,0\.45\]\\rho\\in\[0\.32,0\.45\]across44models, allp<10−9p<10^\{\-9\}\); Qwen and Gemma produce a probeable but not steering\-usable V\-axis \(all\|ρ\|<0\.05\|\\rho\|<0\.05\)\. The base\-vs\-instruct training stage does not predict steerability \(Mistral\-7B\-baseρ=0\.44\\rho\{=\}0\.44matches Mistral\-7B\-Instρ=0\.45\\rho\{=\}0\.45\); the family does\.

## 7Reasoning\-Distillation Depth Shift

The V\-axis is not at the same layer in every LLM\. Mid\-depth \(ℓ≈L/2\\ell\\approx L/2\) is optimal for Llama, Mistral, and Qwen3 instruction\-tuned and base variants;*reasoning\-distilled*models \(DeepSeek\-R1\-Distill, Qwen3\-thinking\) suppress the V\-axis at mid\-depth and recover it near the last layer\. Sweepingℓ∈\{0\.25,0\.50,0\.70,0\.86,1\.00\}×L\\ell\\in\\\{0\.25,0\.50,0\.70,0\.86,1\.00\\\}\\times L: standard models peak atℓ≈0\.50\\ell\{\\approx\}0\.50; DeepSeek\-R1\-Distill\-7B and Qwen3\-32B\-thinking are flat\-near\-chance over\[0\.50,0\.70\]\[0\.50,0\.70\]and recover sharply atℓ=1\.00\\ell\{=\}1\.00\(AUC0\.74→0\.780\.74\\to 0\.78\)\. Qwen3\-8B confirms the shift atℓ=31\\ell\{=\}31\. The shift is V\-axis\-specific: categorical concepts \(§[6](https://arxiv.org/html/2608.18090#S6), item 7\) show no late\-layer recovery in DeepSeek\-R1\-Distill, ruling out a generic late\-layer effect of distillation\. The pattern is consistent with chain\-of\-thought distillation rewarding intermediate\-layer reasoning and pushing direct affect readout toward the unembedding; we do not claim this is the full mechanism\.

## 8Related Work and Discussion

### Concept directions vs\. AxBench\.

Kimet al\.\([2018](https://arxiv.org/html/2608.18090#bib.bib2)\)introduced concept activation vectors;Parket al\.\([2024](https://arxiv.org/html/2608.18090#bib.bib1)\)formalised the LRH for categorical concepts; AxBench\(Wuet al\.,[2025](https://arxiv.org/html/2608.18090#bib.bib3)\)reports supervised\-probe baselines beating SAEs for steering\. The recipe here differs from AxBench on three quantitative axes: \(i\)*label budget*– AxBench uses∼100\\sim\\\!100–1,0001\{,\}000labelled examples per concept; we use99emotion names and99writing prompts \(n=18n\{=\}18total,≥50×\\geq\\\!50\{\\times\}less\); \(ii\)*concept type*– AxBench targets categorical concepts \(where DiffMean wins\); we target continuous valence, and on AxBench’s500500categorical concepts the recipe ties the matched\-norm null \(KSp=0\.41p\{=\}0\.41, App\.[F](https://arxiv.org/html/2608.18090#A6)\); \(iii\)*modality scope*– AxBench is text\-only; we extend to image, audio, and EEG, where one11\-D direction beats a1616\-D generic substrate by0\.180\.18–0\.440\.44AUC \(Table[4](https://arxiv.org/html/2608.18090#S5.T4)\)\.Arditiet al\.\([2024](https://arxiv.org/html/2608.18090#bib.bib4)\)mediate refusal through a single direction; we adopt their protocol\. SAE\-feature work\(Templetonet al\.,[2024](https://arxiv.org/html/2608.18090#bib.bib5)\)operates on dictionary features rather than raw concept directions\.

### Cross\-encoder convergence and brain alignment\.

Huhet al\.\([2024](https://arxiv.org/html/2608.18090#bib.bib6)\)argue diverse encoders converge representationally at scale; our4×44\{\\times\}4matrix extends this to a11\-D task\-relevant direction across modalities with no shared pretraining, ruling out the genericK=16K\{=\}16substrate baseline\.Pang and others \([2026](https://arxiv.org/html/2608.18090#bib.bib7)\)calibrate cross\-encoder CKA against matched\-norm nulls; the V\-axis pairs pass in3/33/3text↔\\leftrightarrowimage↔\\leftrightarrowaudio cells \(p≤0\.032p\\leq 0\.032\)\.Huthet al\.\([2016](https://arxiv.org/html/2608.18090#bib.bib15)\)andToneva and Wehbe \([2019](https://arxiv.org/html/2608.18090#bib.bib16)\)mapped language\-evoked brain activity; our EEG result operates on emotion\-induced video EEG and is a direction\-existence claim, not a biological\-mechanism claim\.

### Limitations and future work\.

The recipe is an empirical regularity, not an analytical theorem; it is bounded to continuous attributes; the EEG axis is supervised; “universal” is scoped to four tested encoders; “causal” refers to inference\-time projection, not counterfactual circuit\-level intervention; steering is family\-specific\. Three falsifiable next steps: build the EEG axis from video\-emotion stimulus metadata to make it label\-free; test whether reasoning distillation restores steerability in Qwen; apply the recipe to other continuous attributes \(toxicity, formality, intensity\)\.

### Acknowledgments\.

We thank Kilich \(KAUST\) for early protocol\-design feedback\. Compute provided by KAUST Ibex\. No external funding\.

## References

- A\. Arditi, O\. Obeso, A\. Sycheva, D\. Paleka, N\. Panickssery, W\. Gurnee, and N\. Nanda \(2024\)Refusal in language models is mediated by a single direction\.Advances in Neural Information Processing Systems \(NeurIPS\)\.Note:arXiv:2406\.11717Cited by:[§1](https://arxiv.org/html/2608.18090#S1.SS0.SSS0.Px2.p1.4),[§1](https://arxiv.org/html/2608.18090#S1.SS0.SSS0.Px5.p1.10),[§1](https://arxiv.org/html/2608.18090#S1.p1.2),[§4](https://arxiv.org/html/2608.18090#S4.SS0.SSS0.Px2.p1.8),[§8](https://arxiv.org/html/2608.18090#S8.SS0.SSS0.Px1.p1.12)\.
- J\. Chen, X\. Wang, C\. Huang, X\. Hu, X\. Shen, and D\. Zhang \(2023\)A large finer\-grained affective computing EEG dataset \(FACED\)\.Scientific Data10\(1\),pp\. 415\.Cited by:[§1](https://arxiv.org/html/2608.18090#S1.SS0.SSS0.Px4.p1.18),[§3](https://arxiv.org/html/2608.18090#S3.SS0.SSS0.Px4.p1.7),[item 15](https://arxiv.org/html/2608.18090#Sx1.I1.i15.p1.1),[item 9](https://arxiv.org/html/2608.18090#Sx1.I1.i9.p1.1)\.
- J\. Chen, Y\. Wang, Y\. Yang, Y\. Ye, and H\. Chen \(2024\)CBraMod: a criss\-cross brain foundation model for EEG decoding\.InAdvances in Neural Information Processing Systems \(NeurIPS\),Cited by:[§1](https://arxiv.org/html/2608.18090#S1.SS0.SSS0.Px4.p1.18),[§1](https://arxiv.org/html/2608.18090#S1.SS0.SSS0.Px9.p1.1),[§3](https://arxiv.org/html/2608.18090#S3.SS0.SSS0.Px4.p1.7)\.
- P\. Ekman \(1992\)An argument for basic emotions\.Cognition and Emotion6\(3–4\),pp\. 169–200\.Cited by:[§1](https://arxiv.org/html/2608.18090#S1.SS0.SSS0.Px3.p1.1)\.
- B\. Elizalde, S\. Deshmukh, M\. Al Ismail, and H\. Wang \(2023\)CLAP: learning audio concepts from natural language supervision\.InIEEE International Conference on Acoustics, Speech and Signal Processing \(ICASSP\),Cited by:[§1](https://arxiv.org/html/2608.18090#S1.SS0.SSS0.Px4.p1.18),[§1](https://arxiv.org/html/2608.18090#S1.SS0.SSS0.Px9.p1.1)\.
- M\. Huh, B\. Cheung, T\. Wang, and P\. Isola \(2024\)The platonic representation hypothesis\.International Conference on Machine Learning \(ICML\)\.Note:arXiv:2405\.07987Cited by:[§1](https://arxiv.org/html/2608.18090#S1.SS0.SSS0.Px10.p1.8),[§5](https://arxiv.org/html/2608.18090#S5.SS0.SSS0.Px5.p1.8),[§8](https://arxiv.org/html/2608.18090#S8.SS0.SSS0.Px2.p1.7)\.
- A\. G\. Huth, W\. A\. de Heer, T\. L\. Griffiths, F\. E\. Theunissen, and J\. L\. Gallant \(2016\)Natural speech reveals the semantic maps that tile human cerebral cortex\.Nature532\(7600\),pp\. 453–458\.Cited by:[§8](https://arxiv.org/html/2608.18090#S8.SS0.SSS0.Px2.p1.7)\.
- B\. Kim, M\. Wattenberg, J\. Gilmer, C\. Cai, J\. Wexler, F\. Viegas, and R\. Sayres \(2018\)Interpretability beyond feature attribution: quantitative testing with concept activation vectors \(TCAV\)\.InInternational Conference on Machine Learning \(ICML\),Cited by:[§8](https://arxiv.org/html/2608.18090#S8.SS0.SSS0.Px1.p1.12)\.
- Panget al\.\(2026\)Revisiting the platonic representation hypothesis: an aristotelian view on cross\-model alignment\.arXiv preprint arXiv:2602\.14486\.Cited by:[§3](https://arxiv.org/html/2608.18090#S3.SS0.SSS0.Px5.p1.4),[§8](https://arxiv.org/html/2608.18090#S8.SS0.SSS0.Px2.p1.7)\.
- K\. Park, Y\. J\. Choe, and V\. Veitch \(2024\)The linear representation hypothesis and the geometry of large language models\.InInternational Conference on Learning Representations \(ICLR\),Note:arXiv:2311\.03658Cited by:[§1](https://arxiv.org/html/2608.18090#S1.SS0.SSS0.Px10.p1.8),[§1](https://arxiv.org/html/2608.18090#S1.SS0.SSS0.Px2.p1.4),[§1](https://arxiv.org/html/2608.18090#S1.SS0.SSS0.Px9.p1.1),[§1](https://arxiv.org/html/2608.18090#S1.p1.2),[§8](https://arxiv.org/html/2608.18090#S8.SS0.SSS0.Px1.p1.12)\.
- K\. J\. Piczak \(2015\)ESC: dataset for environmental sound classification\.InACM Multimedia,Cited by:[§1](https://arxiv.org/html/2608.18090#S1.SS0.SSS0.Px4.p1.18)\.
- A\. Radford, J\. W\. Kim, C\. Hallacy, A\. Ramesh, G\. Goh, S\. Agarwal, G\. Sastry, A\. Askell, P\. Mishkin, J\. Clark, G\. Krueger, and I\. Sutskever \(2021\)Learning transferable visual models from natural language supervision\.InInternational Conference on Machine Learning \(ICML\),Note:arXiv:2103\.00020Cited by:[§1](https://arxiv.org/html/2608.18090#S1.SS0.SSS0.Px4.p1.18),[§1](https://arxiv.org/html/2608.18090#S1.SS0.SSS0.Px9.p1.1)\.
- J\. A\. Russell \(1980\)A circumplex model of affect\.Journal of Personality and Social Psychology39\(6\),pp\. 1161–1178\.Cited by:[§1](https://arxiv.org/html/2608.18090#S1.SS0.SSS0.Px3.p1.1)\.
- R\. Socher, A\. Perelygin, J\. Wu, J\. Chuang, C\. D\. Manning, A\. Y\. Ng, and C\. Potts \(2013\)Recursive deep models for semantic compositionality over a sentiment treebank\.InEmpirical Methods in Natural Language Processing \(EMNLP\),Cited by:[§1](https://arxiv.org/html/2608.18090#S1.SS0.SSS0.Px1.p1.7)\.
- A\. Templeton, T\. Conerly, J\. Marcus, J\. Lindsey, T\. Bricken, B\. Chen, A\. Pearce, C\. Citro, E\. Ameisen, A\. Jermyn,et al\.\(2024\)Scaling monosemanticity: extracting interpretable features from Claude 3 sonnet\.Anthropic Transformer Circuits Thread\.Cited by:[§8](https://arxiv.org/html/2608.18090#S8.SS0.SSS0.Px1.p1.12)\.
- M\. Toneva and L\. Wehbe \(2019\)Interpreting and improving natural\-language processing \(in machines\) with natural language\-processing \(in the brain\)\.InAdvances in Neural Information Processing Systems \(NeurIPS\),Cited by:[§8](https://arxiv.org/html/2608.18090#S8.SS0.SSS0.Px2.p1.7)\.
- J\. Vig, S\. Gehrmann, Y\. Belinkov, S\. Qian, D\. Nevo, Y\. Singer, and S\. M\. Shieber \(2020\)Investigating gender bias in language models using causal mediation analysis\.InAdvances in Neural Information Processing Systems \(NeurIPS\),Cited by:[§4](https://arxiv.org/html/2608.18090#S4.SS0.SSS0.Px5.p1.7)\.
- Z\. Wu, A\. Arora, A\. Geiger, Z\. Wang, J\. Huang, D\. Jurafsky, C\. D\. Manning, and C\. Potts \(2025\)AxBench: steering LLMs? even simple baselines outperform sparse autoencoders\.InInternational Conference on Machine Learning \(ICML\),Note:arXiv:2501\.17148Cited by:[§1](https://arxiv.org/html/2608.18090#S1.SS0.SSS0.Px10.p1.8),[§1](https://arxiv.org/html/2608.18090#S1.SS0.SSS0.Px7.p1.8),[§1](https://arxiv.org/html/2608.18090#S1.SS0.SSS0.Px9.p1.1),[§6](https://arxiv.org/html/2608.18090#S6.p1.15),[§8](https://arxiv.org/html/2608.18090#S8.SS0.SSS0.Px1.p1.12)\.
- J\. Yang, Q\. Huang, T\. Ding, D\. Lischinski, D\. Cohen\-Or, and H\. Huang \(2023\)EmoSet: a large\-scale visual emotion dataset with rich attributes\.InIEEE/CVF International Conference on Computer Vision \(ICCV\),Cited by:[§1](https://arxiv.org/html/2608.18090#S1.SS0.SSS0.Px4.p1.18),[§3](https://arxiv.org/html/2608.18090#S3.SS0.SSS0.Px2.p1.7)\.

## NeurIPS Paper Checklist

1. 1\.Claims\.Do the main claims made in the abstract and introduction accurately reflect the paper’s contributions and scope?Answer:Yes\.Justification:Abstract states \(i\) the recipe, \(ii\) four\-modality probe AUCs, \(iii\) causal ablation drops, \(iv\) cross\-modal transfer; each is established by Sections[2](https://arxiv.org/html/2608.18090#S2)–[5](https://arxiv.org/html/2608.18090#S5)with explicit numbers; “what this is not” \(§[6](https://arxiv.org/html/2608.18090#S6)\) scopes the claim to continuous attributes and seven categorical failure modes\.
2. 2\.Limitations\.Does the paper discuss the limitations of the work performed?Answer:Yes\.Justification:§[8](https://arxiv.org/html/2608.18090#S8)\(Limitations and future work\) enumerates five: \(i\) empirical, not theoretical; \(ii\) bounded to continuous attributes; \(iii\) EEG axis is supervised; \(iv\) “universal” scoped to four tested encoders; \(v\) causal claim is inference\-time\-projection, not counterfactual intervention; family\-specific steering is treated as a separate scope statement\.
3. 3\.Theoretical results\.For each theoretical result, are the full set of assumptions and a complete \(and correct\) proof provided?Answer:N/A\.Justification:The paper is empirical; no theorems are claimed\. §[6](https://arxiv.org/html/2608.18090#S6)explicitly frames the result as “an empirical regularity, not an analytical theorem\.”
4. 4\.Experimental result reproducibility\.Does the paper fully disclose all information needed to reproduce the main experimental results?Answer:Yes\.Justification:Algorithm[1](https://arxiv.org/html/2608.18090#algorithm1)states the recipe end\-to\-end; §[2](https://arxiv.org/html/2608.18090#S2)specifiesNc≈50N\_\{c\}\{\\approx\}50, layer choice protocol, and per\-modality variations; Appendix[A](https://arxiv.org/html/2608.18090#A1)provides the prompt corpus seeds and counts; Appendix[B](https://arxiv.org/html/2608.18090#A2)provides the depth\-search procedure with per\-model peak blocks; Appendix[C](https://arxiv.org/html/2608.18090#A3)provides theNcN\_\{c\}sweep; data\-source pointers in figure/table captions identify the result JSONs \(experiments/d24\_e1\_va\_bakeoff/,experiments/d31\_causal\_mediation/,experiments/d39\_e\_eeg\_salvage/\)\.
5. 5\.Open access to data and code\.Does the paper provide open access to the data and code?Answer:Yes \(planned\)\.Justification:Code \(recipe \+ figures \+ EEG salvage scripts\) will be released under MIT licence at a public GitHub repository linked in the camera\-ready version; the URL is omitted here to preserve double\-blind anonymity\. SST\-2, EmoSet, ESC\-50, and FACED are publicly available; we redistribute only the 9 emotion\-prompt files we authored \(Appendix[A](https://arxiv.org/html/2608.18090#A1)\)\. Pretrained checkpoints are taken from Hugging Face Hub\.
6. 6\.Experimental setting/details\.Does the paper specify all the training and test details \(e\.g\., data splits, hyperparameters, optimisers\)?Answer:Yes\.Justification:§[3](https://arxiv.org/html/2608.18090#S3)per modality: encoder, dataset, layer, split protocol \(5\-fold subject\-stratified for EEG, train/dev/test for SST\-2, held\-out class for ESC\-50, test split for EmoSet\)\. §[4](https://arxiv.org/html/2608.18090#S4): ablation protocol,K=3K\{=\}3matched\-norm random\-direction null seeded\{0,1,2\}\\\{0,1,2\\\}\. §[5](https://arxiv.org/html/2608.18090#S5): logistic\-regression head \(2 parameters, no regularisation; per\-modality sign\-fixing once from source\-positive class\)\.
7. 7\.Experiment statistical significance\.Does the paper report error bars suitably and correctly defined?Answer:Yes\.Justification:EEG result reportsAUC=0\.720±0\.055\\mathrm\{AUC\}=0\.720\\pm 0\.055over 5 subject\-stratified splits with pooled permutationp=3\.65×10−8p\{=\}3\.65\\\!\\times\\\!10^\{\-8\}\. ESC\-50 reports paired\-permutationp=2\.2×10−15p\{=\}2\.2\\\!\\times\\\!10^\{\-15\}across 50 categories\. Causal ablation reportszz\-scores1212–196196relative toK=3K\{=\}3matched\-norm random\-direction null\. Vision permutation null over1,0001\{,\}000random directions \(\|r\|≤0\.112\|r\|\\leq 0\.112\)\.
8. 8\.Experiments compute resources\.Does the paper provide sufficient information on the computer resources?Answer:Yes\.Justification:All experiments run on a single A100 80GB; recipe per LLM \(Llama\-3\-8B\) takes∼2\\sim\\\!2min for450450forward passes; cross\-modal transfer matrix completes in<5<\\\!5min; EEG LDA fit is CPU\-only\. Total compute for the paper is<50<\\\!50A100\-hours\.
9. 9\.Code of ethics\.Does the research conducted in the paper conform with the NeurIPS Code of Ethics?Answer:Yes\.Justification:EEG data \(FACED\) is publicly released under a permissive licence with subject consent and IRB approval as documented inChenet al\.\[[2023](https://arxiv.org/html/2608.18090#bib.bib13)\]; no new human\-subject data is collected\. Steering experiments may have dual\-use concerns \(we discuss briefly in Broader Impact below\)\.
10. 10\.Broader impacts\.Does the paper discuss both potential positive societal impacts and negative societal impacts of the work?Answer:Yes\.Justification:See Broader Impact paragraph below\.
11. 11\.Safeguards\.Does the paper describe safeguards that have been put in place for responsible release of data or models?Answer:N/A\.Justification:No new models or datasets are released; the recipe operates on frozen public encoders\.
12. 12\.Licenses for existing assets\.Are the creators or original owners of assets properly credited and are the license and terms of use explicitly mentioned?Answer:Yes\.Justification:SST\-2 \(CC\-BY 4\.0\), EmoSet \(research\-only\), ESC\-50 \(CC\-BY\-NC\), FACED \(CC\-BY 4\.0\)\. CLIP, CLAP, CBraMod, Llama\-3, Mistral\-7B, Qwen3 used under their respective Hugging Face licences\.
13. 13\.New assets\.Are new assets introduced in the paper well documented?Answer:Yes\.Justification:The 9\-emotion prompt corpus \(450 sentences\) and recipe code are documented in Appendices[A](https://arxiv.org/html/2608.18090#A1)–[C](https://arxiv.org/html/2608.18090#A3)\.
14. 14\.Crowdsourcing and research with human subjects\.Did the paper include the full text of instructions given to participants and screenshots, if applicable?Answer:N/A\.Justification:No new crowdsourcing or human\-subject data collection\.
15. 15\.Institutional review board \(IRB\) approvals\.Does the paper describe potential risks incurred by study participants?Answer:N/A\.Justification:See item 9; FACED IRB documentation is inChenet al\.\[[2023](https://arxiv.org/html/2608.18090#bib.bib13)\]\.
16. 16\.Declaration of LLM usage\.Does the paper describe the usage of LLMs?Answer:Yes\.Justification:The 450 emotion\-anchored prompts were authored by a mix of human writing and LLM\-assisted drafting \(approximately 60% LLM\-assisted draft, 40% human\-original\), then read and class\-verified by the author before being committed to the corpus\. LLM use is part of the artefact being measured \(frozen pretrained encoders\) rather than a writing aid for the manuscript; manuscript text was authored without LLM assistance\.

### Broader Impact\.

The recipe lowers the marginal cost of building affect\-aligned axes in modern foundation models\. Positive applications include label\-efficient sentiment evaluation for low\-resource modalities \(e\.g\., EEG\-based affective interfaces\)\. Negative\-use concerns: the family\-specific causal\-use pattern \(Llama and Mistral steerable\) means the recipe doubles as a low\-cost steering primitive; we document but do not promote dual\-use applications, and emphasise that the causal effect is family\-specific and not a general LLM property\.

## Appendix APrompt corpus and per\-emotion examples

The full 9\-emotion prompt corpus contains∼50\\sim\\\!50paragraph\-length narrative continuations per emotion \(450 total\)\. Per\-emotion example seeds:*anger*: “She slammed the door so hard the frame cracked” \(47 continuations\);*disgust*: “The milk had gone sour weeks ago and he hadn’t noticed” \(52\);*fear*: “Footsteps in the hallway, but she was supposed to be alone” \(50\);*sadness*: “He held the photograph long after the call ended” \(48\);*amusement*: “The dog skidded across the kitchen tiles chasing nothing” \(51\);*joy*: “She read the acceptance letter twice to be sure” \(49\);*inspiration*: “Watching the launch, he finally understood what he wanted to build” \(52\);*tenderness*: “The child fell asleep mid\-sentence on her shoulder” \(50\);*neutral*: “The bus arrived three minutes after the scheduled time” \(51\)\. Full corpus released with code\.

## Appendix BPer\-LLM layer search

Layer search uses SST\-2 dev\-split AUC of the V\-axis as the criterion, sweepingℓ∈\{0\.10,0\.25,0\.50,0\.67,0\.86,1\.00\}×L\\ell\\in\\\{0\.10,0\.25,0\.50,0\.67,0\.86,1\.00\\\}\\times L\. Standard models peak atℓ≈0\.50\\ell\{\\approx\}0\.50–0\.670\.67withΔ​AUC≤0\.02\\Delta\\mathrm\{AUC\}\\leq 0\.02across that band; reasoning\-distilled models peak atℓ≥0\.86\\ell\{\\geq\}0\.86with\>0\.20\>\\\!0\.20AUC drop at mid\-depth\. Per\-model peak layers used in this paper \(Llama\-3\-8B\-Inst: block 20; Mistral\-7B\-Inst: block 16; Qwen3\-1\.7B: block 18; Qwen3\-8B: block 31; DeepSeek\-R1\-Distill\-7B: block 28\) are reported in full inexperiments/d24\_e1\_va\_bakeoff/and the project worklog\.

## Appendix CNcN\_\{c\}sweep

SST\-2 AUC of the Llama\-3\-8B V\-axis as a function of per\-emotion prompt countNc∈\{1,5,10,20,30,50\}N\_\{c\}\\in\\\{1,5,10,20,30,50\\\}:\{0\.500,0\.563,0\.612,0\.694,0\.731,0\.772\}\\\{0\.500,0\.563,0\.612,0\.694,0\.731,0\.772\\\}\. The recipe transitions from chance to non\-trivial AUC atNc≈20N\_\{c\}\{\\approx\}20; gains plateau byNc≈50N\_\{c\}\{\\approx\}50\.

## Appendix DSteering panel \(8\-model\)

Spearmanρ\\rhobetween V\-axis steering coefficientα∈\{−2,−1,0,\+1,\+2\}\\alpha\\in\\\{\-2,\-1,0,\+1,\+2\\\}and downstream sentiment polarity, 500 SST\-2 prompts per coefficient\. Source: D32 generalisation run \(experiments/d32\_steering\_generalize/\)\. Llama\-3\-8B\-Instρ=0\.37\\rho\{=\}0\.37; Llama\-3\-8B\-baseρ=0\.32\\rho\{=\}0\.32; Mistral\-7B\-Instρ=0\.45\\rho\{=\}0\.45; Mistral\-7B\-baseρ=0\.44\\rho\{=\}0\.44; Qwen3\-1\.7B\-Instρ=−0\.02\\rho\{=\}\-0\.02; Qwen3\-8B\-Instρ≈0\\rho\{\\approx\}0; Gemma\-4\-e2bρ=0\.004\\rho\{=\}0\.004; DeepSeek\-R1\-Distill\-Qwen\-1\.5Bρ≈0\\rho\{\\approx\}0\. The Llama–Mistral group passesp<10−9p<10^\{\-9\}\(Mistral\-7B\-base:p=8×10−14p\{=\}8\{\\times\}10^\{\-14\}\); the Qwen–Gemma group is not significant at any threshold\.

## Appendix EDepth\-shift on categorical concepts

We rerun the recipe with 9 categorical\-concept centroids \(CIFAR\-100 superclasses mapped to text descriptions\) on DeepSeek\-R1\-Distill\-7B atℓ∈\{0\.25,0\.50,0\.70,0\.86,1\.00\}×L\\ell\\in\\\{0\.25,0\.50,0\.70,0\.86,1\.00\\\}\\times L\. AUC:\{0\.498,0\.501,0\.504,0\.509,0\.511\}\\\{0\.498,0\.501,0\.504,0\.509,0\.511\\\}\. No late\-layer recovery; flat\-near\-chance everywhere\. The depth shift is V\-axis\-specific, not a generic late\-layer\-effect of distillation\.

## Appendix FAxBench Concept\-500 NULL table

We run the 9\-centroid recipe on AxBench’s 500 categorical concepts in Llama\-3\-8B\-Inst atℓ=16\\ell\{=\}16\. Concept\-direction recovery rate \(AUC of recipe\-direction vs\. AxBench supervised diff\-mean direction\):0\.49±0\.040\.49\\pm 0\.04across 500 concepts\. Matched\-norm random\-direction null:0\.49±0\.050\.49\\pm 0\.05\. Distributions are statistically indistinguishable \(two\-sample KSp=0\.41p\{=\}0\.41\)\. The recipe does not recover categorical\-concept directions\.

## Appendix GESC\-50 per\-class V\-axis breakdown

Per\-class V\-axis AUC on ESC\-50 ranges from0\.610\.61\(silence vs\. everything else, hardest\) to0\.990\.99\(laughing vs\. chainsaw, easiest\)\. Mean0\.9060\.906, median0\.920\.92, paired permutationp=2\.2×10−15p\{=\}2\.2\\\!\\times\\\!10^\{\-15\}across the 50 binary one\-vs\-rest splits\. Top\-5 hardest categories: silence, wind, brushing teeth, washing machine, snoring\. Top\-5 easiest: laughing, crying baby, dog barking, chirping birds, helicopter\.

## Appendix HEEG salvage details

The unsupervised 9\-class PC1 V\-axis on EEG yields self\-AUC0\.5120\.512\. Inspection of class projections on PC1: joy \(\+0\.71\+0\.71\), inspiration \(\+0\.64\+0\.64\), amusement \(\+0\.51\+0\.51\), tenderness \(\+0\.38\+0\.38\), neutral \(\+0\.02\+0\.02\), anger \(\+0\.41\+0\.41\), fear \(\+0\.69\+0\.69\), disgust \(\+0\.48\+0\.48\), sadness \(−0\.21\-0\.21\)\. Joy and fear both project strongly positive; PC1 picks up an arousal\-like direction\. The supervised LDA on binary valence in 200\-D CBraMod feature space yields a direction near\-orthogonal to PC1 \(cosine0\.180\.18\); self\-AUC rises to0\.8670\.867on subject\-stratified 5\-fold CV \(subjects11–9999train,100100–122122held\)\.

## Appendix IFigure: four\-modality bar chart

![Refer to caption](https://arxiv.org/html/2608.18090v1/x3.png)Figure 3:V\-axis recipe \(blue\) matches supervised heads \(grey\) within77pp AUC across four modalities; null directions \(red dashed\) sit at chance\. Bars: V\-axis vs\. supervised performance per modality\. Vision: Pearsonrrto crowdworker valence \(EmoSet\)\. Other modalities: held\-out AUC\. Same numbers as Table[1](https://arxiv.org/html/2608.18090#S3.T1)in the main paper\.

Similar Articles

Where Do Models Find Happiness? Emotion Vectors in Open-Source LLMs

arXiv cs.CL

This paper replicates the finding of 'emotion vectors' in open-weight LLMs Apertus-8B and Gemma-4-E4B, showing that valence geometry is recoverable across models with differences in layer emergence. The study also finds that arousal encoding is sensitive to the story corpus used for extraction.

A Shared Valence Axis Across Modern LLMs and Human EEG: The Saturation Regularity

arXiv cs.LG

This paper discovers a shared valence axis (V-axis) across modern LLMs and human EEG signals, showing that a single direction from LLM internal representations aligns with neural responses to emotional stimuli. It also identifies the saturation regularity, explaining why LLM-derived supervision fails to improve EEG decoding and how leveraging residual diversity boosts performance.

REGARD: Regional Affective Differences in Large Language Models

arXiv cs.CL

This paper introduces REGARD, a study using Valence-Arousal-Dominance profiling to measure affective framing differences across LLMs on post-Soviet entities, revealing that models cluster by emotional intensity and generic-answer rate rather than origin or size.

Negative Before Positive: Asymmetric Valence Processing in Large Language Models

arXiv cs.CL

This paper investigates how large language models process emotional valence through mechanistic interpretability. Using activation patching and steering on three open-source LLMs, the authors find that negative valence is localized to early layers while positive valence peaks in mid-to-late layers, and they validate this through topic-controlled flip tests.