When Do Geometric Algebra Layers Beat Scalarization? A Controlled Study on SO(3)-Equivariant Vector Laws

# When Do Geometric Algebra Layers Beat Scalarization? A Controlled Study on SO(3)-Equivariant Vector Laws
Source: [https://arxiv.org/html/2607.06634](https://arxiv.org/html/2607.06634)
###### Abstract

Compact networks built from Clifford algebraCl​\(3,0\)\\mathrm\{Cl\}\(3,0\)primitives \(grade\-wise equivariant linear maps, geometric products, grade gates\) are exactly SO\(3\)\-equivariant and learn synthetic 3D vector laws from few samples\. We ask whether the geometric algebra structure itself contributes anything beyond exact equivariance\. We compare against a minimal scalarization baseline: invariant dot products fed to a small MLP that outputs coefficients on the equivariant basis\{vi,vi×vj\}\\\{v\_\{i\},\\,v\_\{i\}\\times v\_\{j\}\\\}, which is also exactly equivariant\. On single\-stage laws \(rotation by axis\-angle, cross product, central force\), scalarization matches or beats theCl​\(3,0\)\\mathrm\{Cl\}\(3,0\)network at a fraction of the training cost, so the geometric algebra adds nothing there\. On compositional targets whose computation graph nests group operations \(applyR2​R1R\_\{2\}R\_\{1\}to a point; map a local force through an orientation, then take a torque\), theCl​\(3,0\)\\mathrm\{Cl\}\(3,0\)network beats scalarization by an order of magnitude in the low\-data regime, reaching with 100 samples the accuracy the baseline achieves with 3000, and the gap survives strengthening the baseline with the triple\-product invariant and 17x more parameters, external Vector Neurons and e3nn baselines, and a multiplicative coefficient network\. Ablations show the required network depth tracks the rotation chain length, and scalarization falls below the constant predictor on chains of four rotations\. The advantage is not composition per se: on a rotation\-free nested cross product, which flattens into polynomial invariant coefficients, scalarization wins by 24x\. On the torque task the advantage is confined to low data, with a crossover near a thousand samples\. No tested model, equivariant or not, extrapolates invariant magnitudes: on radius and separation shifts every model is worse than a constant predictor once errors are normalized\. We conclude that geometric algebra layers are not a general shortcut for low\-data 3D learning, but become useful precisely when the target composes group elements in depth\.

## 1Introduction

Many 3D learning problems require functions that commute with rotations: a predicted force, torque, or displacement should rotate with the input frame\. Equivariant architectures encode this constraint in the parameterization, and small\-scale demonstrations routinely show large sample\-efficiency gains over unconstrained networks\. Such demonstrations, however, usually conflate two distinct effects: \(a\) restricting the hypothesis class to equivariant functions, and \(b\) the specific parameterization of the proposed architecture\. Effect \(a\) is available from a trivial construction\. By classical invariant theory, every SO\(3\)\-equivariant vector\-valued function of vectorsv1,…,vkv\_\{1\},\\dots,v\_\{k\}can be written as∑jcj​\(invariants\)​bj\\sum\_\{j\}c\_\{j\}\(\\text\{invariants\}\)\\,b\_\{j\}, where thebjb\_\{j\}range over the inputs and their pairwise cross products and thecjc\_\{j\}are functions of the SO\(3\) invariants of the inputs: the pairwise dot products and, for orientation\-sensitive \(chiral\) targets, the scalar triple productsva⋅\(vb×vc\)v\_\{a\}\\cdot\(v\_\{b\}\\times v\_\{c\}\)\[[14](https://arxiv.org/html/2607.06634#bib.bib1)\]\. Learning thecjc\_\{j\}with a small MLP gives an exactly equivariant model that we call*scalarization*\. Our base scalarization uses the dot\-product invariants; the strengthened variant adds the triple products, and the two tasks with three or more inputs \(two\-body, nested cross\) test whether that matters\.

This paper asks a narrow question: does a small geometric algebra network built fromCl​\(3,0\)\\mathrm\{Cl\}\(3,0\)bilinear layers offer anything that scalarization does not? We answer it with a controlled benchmark of six synthetic vector laws, normalized metrics, tuning controls, and strengthened baseline variants\. Our contributions are negative and positive results of equal importance:

1. 1\.On single\-stage laws, those computable with one equivariant interaction \(rotation of a point, cross product, central force\), scalarization matches or beats the geometric algebra network, at 13 to 19x lower training cost \(Section[5](https://arxiv.org/html/2607.06634#S5), Finding 2\)\.
2. 2\.On compositional laws, those whose computation graph nests group operations \(composition of two rotations, local\-to\-world torque\), the geometric algebra network wins by 3x to 16x in the low\-data regime and under angle shift, and the gap survives capacity and feature strengthening of the baseline; on the torque task scalarization catches up beyond a thousand samples \(Finding 3, Figure[1](https://arxiv.org/html/2607.06634#S5.F1)\)\.
3. 3\.No tested model extrapolates invariant magnitudes\. On radial out\-of\-distribution splits, every model, equivariant or not, is worse than a constant predictor once errors are normalized \(Finding 4\)\. Unnormalized MSE hides this failure, which we argue is a reporting pitfall for equivariance benchmarks\.

## 2Related work

Equivariant deep learning encodes group symmetry in the architecture\[[5](https://arxiv.org/html/2607.06634#bib.bib8),[4](https://arxiv.org/html/2607.06634#bib.bib13)\]\. For 3D rotations, irreducible\-representation approaches include Tensor Field Networks\[[13](https://arxiv.org/html/2607.06634#bib.bib6)\], the e3nn framework\[[10](https://arxiv.org/html/2607.06634#bib.bib7)\], and steerable networks\[[15](https://arxiv.org/html/2607.06634#bib.bib9)\]; lighter\-weight constructions include Vector Neurons\[[6](https://arxiv.org/html/2607.06634#bib.bib2)\]and E\(n\)\-equivariant graph networks\[[12](https://arxiv.org/html/2607.06634#bib.bib10)\]\. Equivariance is known to improve data efficiency in the sciences\[[1](https://arxiv.org/html/2607.06634#bib.bib11)\]\. Geometric \(Clifford\) algebra architectures embed inputs as multivectors and use the geometric product as the core operation\[[2](https://arxiv.org/html/2607.06634#bib.bib3),[11](https://arxiv.org/html/2607.06634#bib.bib4),[3](https://arxiv.org/html/2607.06634#bib.bib5)\]\. On the analysis side,Villaret al\.\[[14](https://arxiv.org/html/2607.06634#bib.bib1)\]characterize equivariant functions through scalar invariants, which directly motivates our scalarization baseline, andDym and Maron \[[8](https://arxiv.org/html/2607.06634#bib.bib12)\]study the universality of rotation\-equivariant models\. Closest to our baseline,Dominaet al\.\[[7](https://arxiv.org/html/2607.06634#bib.bib15)\]express equivariant targets as scalar functions multiplying a small tensor basis; closest to our geometric model, GLGENN\[[9](https://arxiv.org/html/2607.06634#bib.bib16)\]builds parameter\-light Clifford equivariant networks\. Unlike GATr, which scales a projective geometric algebra transformer to large scenes, we work at the opposite end: a minimal controlled benchmark isolating what the algebra contributes\. Our contribution is not a new architecture: it is a controlled delimitation of when the geometric product parameterization pays relative to the scalarization construction that theory already provides\.

## 3Models

All models map 6 or 9 input dimensions \(two or three 3D vectors\) to one 3D vector and are trained identically: Adam, full batch, 200 epochs, learning rate5×10−35\\times 10^\{\-3\}, mean squared error\. A grid over learning rate and epochs \(Section[6](https://arxiv.org/html/2607.06634#S6)\) confirms that no conclusion is an artifact of this choice\.

#### MLP \(7\.4k parameters\)\.

Three hidden ReLU layers of width 58 on the flattened input\. Unconstrained reference\.

#### MLP\-Aug\.

The same MLP trained with 8x random SO\(3\) data augmentation, rotating all input vectors and the target with the same rotation\.

#### Scalarization \(1\.3k to 1\.5k parameters\)\.

All pairwise dot products of thekkinput vectors feed a two\-layer MLP of width 32 that outputs one coefficient per basis element\{vi\}∪\{vi×vj\}i<j\\\{v\_\{i\}\\\}\\cup\\\{v\_\{i\}\\times v\_\{j\}\\\}\_\{i<j\}; the output is the coefficient\-weighted sum\. Exactly SO\(3\)\-equivariant\. Fork=3k=3a strengthened variant adds the scalar triple productv1⋅\(v2×v3\)v\_\{1\}\\cdot\(v\_\{2\}\\times v\_\{3\}\)to the invariants, making orientation\-sensitive information directly available to the coefficient network\.

#### Vector Neurons \(2\.4k to 2\.6k parameters\)\.

An external equivariant baseline\[[6](https://arxiv.org/html/2607.06634#bib.bib2)\]: channels are 3D vectors, linear layers mix channels with learned scalars, and the VN\-ReLU nonlinearity projects each feature on the halfspace defined by a learned direction\. Faithful to the original design, the output lies in the linear span of the input channels, so a two\-vector input cannot produce a cross product\. We therefore also test VN\-Cross, the common practical fix that appends pairwise cross products of the inputs as extra channels\.

#### E3NN \(6\.6k to 11k parameters\)\.

A second external baseline built from irreducible\-representation tensor products, the standard construction behind irreps equivariant models\[[13](https://arxiv.org/html/2607.06634#bib.bib6),[10](https://arxiv.org/html/2607.06634#bib.bib7)\]\. Inputs arel=1l\{=\}1irreps, each block is a self tensor product gated by scalar channels with an equivariant BatchNorm, and the norm of each input vector is expanded into a small Gaussian radial basis fed as extra scalar channels\. This radial embedding is standard in irreps models\[[1](https://arxiv.org/html/2607.06634#bib.bib11)\]and was necessary here: without it the network cannot represent functions of an angle magnitude and stays worse than a plain MLP on the rotation task\. As this benchmark is SO\(3\) rather than full O\(3\), all irreps use a single parity, which sidesteps a channel\-pruning failure mode we observed when mixing parities\.

#### GeoBilinear \(28k parameters\)\.

Inputs are embedded as multivectors ofCl​\(3,0\)\\mathrm\{Cl\}\(3,0\)\(8 components per channel: vectors on grade 1, axis\-angle inputs on grade 2 via duality\)\. Three stacked blocks computegp​\(A​x,B​x\)\+C​x\\mathrm\{gp\}\(Ax,Bx\)\+Cxwheregp\\mathrm\{gp\}is the geometric product andA,B,CA,B,Care unconstrained linear maps on multivector channels, followed by a grade\-norm gate and channel normalization\. Ablation control: geometric products without the equivariant constraint\.

#### GeoEquivariant \(2k parameters\)\.

The same architecture with grade\-wise weight tying \(one scalar per grade per channel pair\), which makes every layer exactly SO\(3\)\-equivariant\. Measured relative equivariance error is2×10−72\\times 10^\{\-7\}, the float32 limit\. The augmented MLP, for comparison, reaches 0\.22 to 0\.49 depending on the task\.

## 4Tasks and protocol

Inputs are standard normal unless stated\. Train and test sets use disjoint random generator seeds; out\-of\-distribution \(OOD\) splits use disjoint input regions, verified numerically\. Five seeds per configuration; we report mean normalized MSE \(NMSE\): test MSE divided by the MSE of the constant mean predictor on the test targets\. NMSE 1\.0 equals a trivial predictor\. We use NMSE because raw MSE is misleading under distribution shift: on far\-radius splits the targets are small, so a failing model still gets a small raw MSE\.

1. 1\.rotation:\(u,p\)↦R​\(u\)​p\(u,p\)\\mapsto R\(u\)\\,pwithuuan axis\-angle vector\. OOD: unseen axis hemisphere; unseen angle range\[π/2,π\]\[\\pi/2,\\pi\]after training on\[0,π/2\]\[0,\\pi/2\]\.
2. 2\.cross:\(a,b\)↦a×b\(a,b\)\\mapsto a\\times b\. OOD: unseen hemisphere\.
3. 3\.central force:\(r,d\)↦−r/\(∥r∥3\+0\.05\)\(r,d\)\\mapsto\-r/\(\\lVert r\\rVert^\{3\}\+0\.05\)with a distractor inputdd\. OOD: radii\[1\.25,3\]\[1\.25,3\]after training on\[0\.25,1\]\[0\.25,1\]\.
4. 4\.two\-body force:\(r1,r2\)↦−\(r1−r2\)/\(∥r1−r2∥3\+0\.05\)\(r\_\{1\},r\_\{2\}\)\\mapsto\-\(r\_\{1\}\-r\_\{2\}\)/\(\\lVert r\_\{1\}\-r\_\{2\}\\rVert^\{3\}\+0\.05\)\. OOD: separations\[2,4\]\[2,4\]after training on\[0\.5,1\.5\]\[0\.5,1\.5\]\.
5. 5\.composed rotations:\(u1,u2,p\)↦R​\(u2\)​R​\(u1\)​p\(u\_\{1\},u\_\{2\},p\)\\mapsto R\(u\_\{2\}\)R\(u\_\{1\}\)\\,p\. OOD: unseen hemisphere for both axes\.
6. 6\.local\-to\-world torque:\(r,u,f\)↦r×\(R​\(u\)​f\)\(r,u,f\)\\mapsto r\\times\(R\(u\)f\), a local force mapped to the world frame and applied at a lever arm, the minimal robotics composition\. OOD: unseen axis hemisphere; unseen angle range\.

We call tasks 1 to 4 single\-stage: their targets require one equivariant interaction of the inputs, possibly modulated by a learned function of invariants\. Tasks 5 and 6 are compositional: their computation graph nests group operations\. All tasks lie within the intended approximation class of both equivariant model families, and neither family faces a symmetry\-induced expressivity obstruction on these targets, so differences measure optimization behavior and inductive fit rather than hard expressivity gaps\.

## 5Results

![Refer to caption](https://arxiv.org/html/2607.06634v1/x1.png)Figure 1:Sample efficiency on the compositional tasks, NMSE versus training set size, mean over 10 seeds, shaded bands are one standard deviation\. On composed rotations the geometric network atn=100n\{=\}100already beats scalarization atn=3000n\{=\}3000and the gap never closes\. On the torque task the advantage is confined to low data: scalarization overtakes beyondn≈1000n\\approx 1000\.![Refer to caption](https://arxiv.org/html/2607.06634v1/x2.png)Figure 2:NMSE overview per task and model \(log scale, mean over 5 seeds, error bars over seeds\)\. Right panel OOD splits: angle shift for rotation and torque, axis shift for cross and composed rotations, radius shift for central force, separation shift for two\-body\. The dashed line marks the constant predictor\. Generated bypaper/make\_figures\.py\.### 5\.1Finding 1: exact equivariance dominates, whatever its construction

Atn=100n\{=\}100on the rotation task, NMSE is 0\.53 for the MLP, 0\.14 for the augmented MLP, 0\.011 for scalarization and 0\.0036 for GeoEquivariant\. Augmentation reduces the measured equivariance error \(0\.28 to 0\.22\) but stays 10 to 20x behind the exact constructions on directional OOD splits\. This pattern holds on all six tasks \(Table[1](https://arxiv.org/html/2607.06634#S5.T1), Table[2](https://arxiv.org/html/2607.06634#S5.T2)\)\.

### 5\.2Finding 2: on single\-stage laws, scalarization is enough

Table 1:Single\-stage tasks, NMSE \(mean±\\pmstd over 5 seeds\), 200 epochs\. The OOD split is the axis shift for rotation and cross, the radius shift for central force, and the separation shift for two\-body\. Values above 1\.0 are worse than a constant predictor; the large OOD entries are real failures, amplified by normalization against small far\-field targets\.s/runis mean training wall\-clock per run \(CPU\)\.On the cross product atn=1000n\{=\}1000, scalarization reaches NMSE5\.4×10−45\.4\\times 10^\{\-4\}against1\.4×10−21\.4\\times 10^\{\-2\}for GeoEquivariant, a 26x gap\. With a modest tuning grid, scalarization also beats GeoEquivariant on rotation \(4\.7×10−44\.7\\times 10^\{\-4\}vs3\.1×10−33\.1\\times 10^\{\-3\}\) and central force \(1\.2×10−31\.2\\times 10^\{\-3\}vs7\.3×10−37\.3\\times 10^\{\-3\}\)\. GeoEquivariant plateaus around NMSE3×10−33\\times 10^\{\-3\}to1\.4×10−21\.4\\times 10^\{\-2\}on these tasks\. The ablation explains the plateau: removing EquiNorm lets the best seeds reach9×10−59\\times 10^\{\-5\}on the cross product, matching the strongest baselines, but training becomes unreliable \(seed range10−410^\{\-4\}to0\.10\.1, and up to 1\.1 on rotation\)\. The channel normalization trades peak fit for optimization stability; GradeGate removal changes little\. The external baselines sharpen the picture: vanilla Vector Neurons sit exactly at the trivial predictor on the cross product \(NMSE 1\.00, the target leaves the linear span of the inputs\), while VN\-Cross reaches1\.2×10−41\.2\\times 10^\{\-4\}atn=1000n\{=\}1000, the best result of any model on that task\. The irreps baseline E3NN, despite being the standard construction of the field, is the weakest of the three equivariant models on every single\-stage task \(cross atn=100n\{=\}100: 0\.44, against 0\.006 for scalarization\), which underscores that generic equivariance without a task\-matched parameterization is not enough at this scale\. Any claim thatCl​\(3,0\)\\mathrm\{Cl\}\(3,0\)layers as such help on simple vector laws is not supported\.

### 5\.3Finding 3: composition is where geometric algebra pays

Table 2:Compositional tasks, NMSE \(mean over 5 seeds\), 200 epochs\.Table 3:Strengthened scalarization control on the compositional tasks \(5 seeds\)\. Widening the baseline and adding the triple\-product invariant does not close the gap\.On composed rotations, GeoEquivariant reaches NMSE 0\.031 / 0\.012 / 0\.0092 \(n=100n\{=\}100/n=1000n\{=\}1000/ OOD axes\) against 0\.54 / 0\.087 / 0\.055 for scalarization\. Strengthening the baseline with the triple\-product invariant, width 128 and depth 3 \(35k parameters against 2k\) only closes the gap to 0\.29 / 0\.038 / 0\.020, still 9x / 3x / 2x behind \(Table[3](https://arxiv.org/html/2607.06634#S5.T3)\)\. The result holds against both external baselines: on composed rotations VN\-Cross stays 6x to 17x behind GeoEquivariant at every training size \(0\.12 vs 0\.012 atn=1000n\{=\}1000\), vanilla Vector Neurons never leave the 0\.6 to 1\.3 range, and E3NN, though a native irreps architecture, is worse still in low data \(1\.35 atn=100n\{=\}100, over 40x behind\) and only reaches 0\.19 on the OOD axis split against 0\.0092\. The sample\-efficiency curves \(Figure[1](https://arxiv.org/html/2607.06634#S5.F1), 10 seeds\) sharpen this: on composed rotations GeoEquivariant atn=100n\{=\}100\(NMSE 0\.034\) already beats scalarization atn=3000n\{=\}3000\(0\.051\), the gap is 16x atn=100n\{=\}100and still 5x atn=3000n\{=\}3000\. The pattern replicates on the torque task with an honest caveat: the advantage concentrates in low data \(3x atn=30n\{=\}30\) and under angle shift \(2\.8x against the plain baseline, 1\.9x against the strongest variant\), but scalarization crosses over nearn=1000n\{=\}1000and leads atn=3000n\{=\}3000\(0\.016 vs 0\.029\)\. The unconstrained MLP fails on the torque task even iid atn=1000n\{=\}1000\(NMSE 0\.66\)\.

The mechanism: a rotor is an element ofCl​\(3,0\)\\mathrm\{Cl\}\(3,0\)and rotor composition is one geometric product, so depth\-stacked products represent the target natively, while a fixed equivariant basis with learned invariant coefficients must approximate the composition map through its scalar MLP\. Three ablations test this reading directly \(Table[4](https://arxiv.org/html/2607.06634#S5.T4)\)\.

First, on chains ofLLrotations \(p↦RL​⋯​R1​pp\\mapsto R\_\{L\}\\cdots R\_\{1\}p,n=1000n\{=\}1000\), the network depth required for low error tracks the composition depth: each added block gains roughly an order of magnitude on longer chains, and depth 1 fails even atL=1L\{=\}1\(a rotor sandwich takes two products\)\. Scalarization degrades catastrophically with chain length, from 0\.004 atL=1L\{=\}1to worse than the constant predictor atL=4L\{=\}4\(NMSE 1\.9\), while the depth\-4 geometric network stays at 0\.062\.

Second, replacing the ReLU coefficient network of scalarization by multiplicative units,\(A​x\)⊙\(B​x\)\+C​x\(Ax\)\\odot\(Bx\)\+Cx, does not close the gap \(compose\_rotationn=1000n\{=\}1000: 0\.22 against 0\.012\) and is much worse in low data \(7\.1 atn=100n\{=\}100\)\. Generic multiplicative depth is not the explanation; the typed Clifford product is doing specific work\.

Third, composition alone is not where the advantage comes from\. On the rotation\-free composition\(a,b,c\)↦a×\(b×c\)\(a,b,c\)\\mapsto a\\times\(b\\times c\), scalarization wins by 24x over GeoEquivariant \(0\.0028 against 0\.068 atn=1000n\{=\}1000\)\. The reason is classical: the identitya×\(b×c\)=b​\(a⋅c\)−c​\(a⋅b\)a\\times\(b\\times c\)=b\\,\(a\\cdot c\)\-c\\,\(a\\cdot b\)flattens this target into polynomial invariant coefficients on the fixed basis, exactly scalarization’s regime\. Chained rotations also flatten in principle, but into increasingly complex coefficient functions of the invariants\. The refined claim is therefore: the geometric advantage tracks the complexity of the invariant\-coefficient functions needed to flatten the target, not composition per se\.

Table 4:Depth against composition depth: NMSE \(mean over 5 seeds\) of GeoEquivariant with depth 1 to 4 on chains ofLLrotations,n=1000n\{=\}1000iid, with scalarization as reference\. Bold: best per row\.
### 5\.4Finding 4: nobody extrapolates invariant magnitudes

On angle, radius and separation shifts, every model degrades badly\. On the radial splits all models are worse than the constant predictor: GeoEquivariant reaches NMSE 2\.9 \(central force, far radii\) and 4\.4 \(two\-body, far separations\); the MLP reaches 9\.6 and 19; scalarization degrades worst, up to 817, because its learned radial coefficients extrapolate freely\. Equivariance constrains directions, not the response to invariant magnitudes\. On angle shift the equivariant models remain below trivial but far from solved \(0\.23 to 0\.26\); GeoEquivariant only degrades more slowly than scalarization \(0\.43 to 1\.8\)\. We note that unnormalized MSE inverts this conclusion on the radial splits, because far\-field targets are small; earlier internal reports of this project made exactly that mistake\.

### 5\.5Cost

GeoEquivariant is the slowest model per run at these sizes, 13 to 19x the MLP and scalarization training time, despite having the fewest parameters among the learned models except scalarization\. Scalarization is the cheapest model across the board\.

## 6Controls

#### Optimization fairness\.

All models in the main tables received an identical fixed budget: Adam, full batch, 200 epochs, learning rate5×10−35\\times 10^\{\-3\}, one training run per seed, no early stopping, no model selection\. A tuning grid over learning rate\{10−3,5×10−3,2×10−2\}\\\{10^\{\-3\},5\\times 10^\{\-3\},2\\times 10^\{\-2\}\\\}and epochs\{500,2000\}\\\{500,2000\\\}atn=1000n\{=\}1000was additionally applied to the two baselines most at risk of being under\-tuned: it improves the MLP by 30 to 50 percent \(rotation: 0\.101 to 0\.072\) and improves scalarization to the values quoted in Finding 2\. GeoEquivariant and the Vector Neurons variants were not tuned, so the grid can only favor the baselines\. Wall\-clock numbers are means over all runs of a configuration on an Intel i5\-5300U \(4 threads, PyTorch 2\.12 CPU\); the sample\-efficiency curves ran on an RTX 4070 Ti with identical results on overlapping configurations\.

#### Seed stability\.

Per\-seed values for every cell are in the repository\. The large OOD means are heavy\-tailed across seeds; medians tell the same story \(central force OOD radius: scalarization 546, MLP 7\.3, GeoEquivariant 2\.3; two\-body OOD separation: GeoEquivariant 3\.0\), so no conclusion rests on an outlier seed\.

#### Data and split hygiene\.

Train and test generators are disjoint; OOD regions are disjoint by construction and verified numerically \(hemisphere sign fractions, radius ranges\)\.111A task added during exploration \(local\_force\) turned out to be the rotation task under a different name, with per\-seed identical results\. It is excluded from the evidence and documented in the repository\.

## 7Limitations

Synthetic tasks with exactly realizable targets; two compositional tasks, both built from the same rotation primitive\. The external baselines \(Vector Neurons, e3nn\) are compact untuned instances, not the large tuned models these frameworks reach on real datasets, so their weakness here speaks to the low\-data small\-scale regime, not to the frameworks in general\. Five seeds on the main tables\. Results are small scale \(thousands of samples, 2k\-parameter models\); we make no claim about behavior at scale\. The flattening\-complexity reading of Finding 3 is supported by the ablations but not yet formalized\.

## 8Conclusion

Exact SO\(3\) equivariance, not geometric algebra, explains most of the gains that smallCl​\(3,0\)\\mathrm\{Cl\}\(3,0\)networks show on simple 3D vector laws: a trivial scalarization baseline matches or beats them at a fraction of the cost\. The geometric product earns its place when the target composes group elements, where it wins by 2\.5x to 9x in low data and under angle shift against strengthened baselines\. Neither approach extrapolates invariant magnitudes, and unnormalized metrics can hide this failure\. For practitioners the guidance is: reach for scalarization first, including for compositions that flatten into simple invariant coefficients; consider geometric algebra layers when the law chains group operations whose flattened coefficient functions are complex, especially in low data, keeping in mind that the advantage is task\-dependent and can disappear with more data\.

## References

- \[1\]S\. Batzner, A\. Musaelian, L\. Sun, M\. Geiger, J\. P\. Mailoa, M\. Kornbluth, N\. Molinari, T\. E\. Smidt, and B\. Kozinsky\(2022\)E\(3\)\-equivariant graph neural networks for data\-efficient and accurate interatomic potentials\.Nature Communications13\.External Links:[Document](https://dx.doi.org/10.1038/s41467-022-29939-5),2101\.03164Cited by:[§2](https://arxiv.org/html/2607.06634#S2.p1.1),[§3](https://arxiv.org/html/2607.06634#S3.SS0.SSS0.Px5.p1.1)\.
- \[2\]J\. Brandstetter, R\. van den Berg, M\. Welling, and J\. K\. Gupta\(2023\)Clifford neural layers for PDE modeling\.InInternational Conference on Learning Representations,External Links:2209\.04934Cited by:[§2](https://arxiv.org/html/2607.06634#S2.p1.1)\.
- \[3\]J\. Brehmer, P\. de Haan, S\. Behrends, and T\. Cohen\(2023\)Geometric algebra transformer\.InAdvances in Neural Information Processing Systems,Vol\.36\.External Links:2305\.18415Cited by:[§2](https://arxiv.org/html/2607.06634#S2.p1.1)\.
- \[4\]M\. M\. Bronstein, J\. Bruna, T\. Cohen, and P\. Veličković\(2021\)Geometric deep learning: grids, groups, graphs, geodesics, and gauges\.arXiv preprint arXiv:2104\.13478\.Cited by:[§2](https://arxiv.org/html/2607.06634#S2.p1.1)\.
- \[5\]T\. S\. Cohen and M\. Welling\(2016\)Group equivariant convolutional networks\.InInternational Conference on Machine Learning,External Links:1602\.07576Cited by:[§2](https://arxiv.org/html/2607.06634#S2.p1.1)\.
- \[6\]C\. Deng, O\. Litany, Y\. Duan, A\. Poulenard, A\. Tagliasacchi, and L\. J\. Guibas\(2021\)Vector neurons: a general framework for SO\(3\)\-equivariant networks\.InIEEE/CVF International Conference on Computer Vision \(ICCV\),External Links:2104\.12229Cited by:[§2](https://arxiv.org/html/2607.06634#S2.p1.1),[§3](https://arxiv.org/html/2607.06634#S3.SS0.SSS0.Px4.p1.1)\.
- \[7\]M\. Domina, F\. Bigi, P\. Pegolo, and M\. Ceriotti\(2025\)Representing spherical tensors with scalar\-based machine\-learning models\.arXiv preprint arXiv:2505\.05404\.Cited by:[§2](https://arxiv.org/html/2607.06634#S2.p1.1)\.
- \[8\]N\. Dym and H\. Maron\(2021\)On the universality of rotation equivariant point cloud networks\.InInternational Conference on Learning Representations,External Links:2010\.02449Cited by:[§2](https://arxiv.org/html/2607.06634#S2.p1.1)\.
- \[9\]E\. Filimoshina and D\. Shirokov\(2025\)GLGENN: a novel parameter\-light equivariant neural networks architecture based on clifford geometric algebras\.InInternational Conference on Machine Learning,External Links:2506\.09625Cited by:[§2](https://arxiv.org/html/2607.06634#S2.p1.1)\.
- \[10\]M\. Geiger and T\. Smidt\(2022\)E3nn: euclidean neural networks\.arXiv preprint arXiv:2207\.09453\.Cited by:[§2](https://arxiv.org/html/2607.06634#S2.p1.1),[§3](https://arxiv.org/html/2607.06634#S3.SS0.SSS0.Px5.p1.1)\.
- \[11\]D\. Ruhe, J\. Brandstetter, and P\. Forré\(2023\)Clifford group equivariant neural networks\.InAdvances in Neural Information Processing Systems,Vol\.36\.External Links:2305\.11141Cited by:[§2](https://arxiv.org/html/2607.06634#S2.p1.1)\.
- \[12\]V\. G\. Satorras, E\. Hoogeboom, and M\. Welling\(2021\)E\(n\) equivariant graph neural networks\.InInternational Conference on Machine Learning,External Links:2102\.09844Cited by:[§2](https://arxiv.org/html/2607.06634#S2.p1.1)\.
- \[13\]N\. Thomas, T\. Smidt, S\. Kearnes, L\. Yang, L\. Li, K\. Kohlhoff, and P\. Riley\(2018\)Tensor field networks: rotation\- and translation\-equivariant neural networks for 3D point clouds\.arXiv preprint arXiv:1802\.08219\.Cited by:[§2](https://arxiv.org/html/2607.06634#S2.p1.1),[§3](https://arxiv.org/html/2607.06634#S3.SS0.SSS0.Px5.p1.1)\.
- \[14\]S\. Villar, D\. W\. Hogg, K\. Storey\-Fisher, W\. Yao, and B\. Blum\-Smith\(2021\)Scalars are universal: equivariant machine learning, structured like classical physics\.InAdvances in Neural Information Processing Systems,Vol\.34\.External Links:2106\.06610Cited by:[§1](https://arxiv.org/html/2607.06634#S1.p1.6),[§2](https://arxiv.org/html/2607.06634#S2.p1.1)\.
- \[15\]M\. Weiler and G\. Cesa\(2019\)General E\(2\)\-equivariant steerable CNNs\.InAdvances in Neural Information Processing Systems,Vol\.32\.External Links:1911\.08251Cited by:[§2](https://arxiv.org/html/2607.06634#S2.p1.1)\.