Hyperbolic Latent Geometry for Tree-Structured Prototype Networks: A Local-vs-Global Trade-off
Summary
This paper investigates the impact of using hyperbolic versus Euclidean latent geometry for tree-structured regularizers in prototype networks, showing that hyperbolic prototypes significantly improve local topology preservation in hierarchical classification on WikiArt.
View Cached Full Text
Cached at: 08/27/26, 09:36 AM
# Hyperbolic Latent Geometry for Tree-StructuredPrototype Networks: A Local-vs-Global Trade-off Source: [https://arxiv.org/html/2608.25199](https://arxiv.org/html/2608.25199) Peter FloAffiliation:Harvard University, Cambridge, MA, USACorrespondence to:[pgrindehollevik@g\.harvard\.edu](mailto:[email protected]) ###### Abstract We study a tree\-structured regularizer over class\-prototype layouts in a hierarchical\-classification model and ask whether the choice of latent manifold for the prototypes \(Euclideanℝd\\mathbb\{R\}^\{d\}vs\. the Poincaré ball𝔹cd\\mathbb\{B\}^\{d\}\_\{c\}\) affects how well that regularizer can be satisfied without distorting the data likelihood\. The two manifolds differ only in their volume growth: hyperbolic space grows exponentially with radius and embeds trees with provably lower distortion thanℝd\\mathbb\{R\}^\{d\}of matched dimension, so the structured regularizer should be cheaper to satisfy on𝔹cd\\mathbb\{B\}^\{d\}\_\{c\}\. Across 150 seed\-replicated regularized maximum\-likelihood fits spanning embedding dimension, curvature, and regularizer strength on WikiArt \(27 styles, 81,446 paintings, frozen CLIP ViT\-B/16 features\), we find a single robust effect: Poincaré prototypes preserve the topology of the nearest\-neighbor graph in latent space substantially better than matched Euclidean prototypes \(sibling recall@5\+8\.7\+8\.7pp, cousin recall\+15\.2\+15\.2pp; paired\-ttp<10−4p<10^\{\-4\}, sign agreement0\.940\.94\), and the gap holds across three reference\-tree definitions \(hand\-built lineage, CLIP\-derived, and DINOv2\-derived\)\. On classification, Euclidean prototypes are tied with logistic regression on raw encoder features, indicating no detectable contribution from the latent geometry; only the hyperbolic fit improves on akk\-NN encoder baseline for local retrieval\. Global tree\-fidelity comparisons are unstable across reference trees and we do not claim a winner\. The results give an empirical separation, on a real hierarchical\-classification problem, between two natural latent geometries for a class\-structured regularizer\. ###### Keywords: hyperbolic geometry, structured regularization, hierarchical classification, prototype networks, Poincaré ball ## 1Introduction Many real\-world classification problems carry an externally specified hierarchy over class labels: artistic\-style movements branch into one another\([Tan et al\., 2019](https://arxiv.org/html/2608.25199#bib.bib4)\), biological taxa nest into clades, and ontologies of products, diseases, and documents are organised as trees\. A natural way to fold that hierarchy into a probabilistic classification model is to add a tree\-structured regularizer to the layout of class\-conditional parameters\. We study the simplest version of this: a prototype classifier whose class\-conditional likelihood is a softmax over distance\-to\-prototype, with a regularizer on the matrix of pairwise prototype distances pulling it toward the tree\-distance matrix\. The fitted classifier is then a balance between a class\-likelihood term \(paintings of stylekkshould be close to prototype𝐩k\\mathbf\{p\}\_\{k\}\) and a tree\-shape term \(prototypes themselves should respect the hierarchy\)\. The choice of latent manifold for the prototypes is the question this paper investigates\. Forcing a tree’s exponentially\-growing leaf count into Euclideanℝd\\mathbb\{R\}^\{d\}, whose ball volume grows only polynomially in radius, induces unavoidable distortion of pairwise distances; this distortion has been characterised analytically and shown to drop sharply on the Poincaré ball𝔹cd\\mathbb\{B\}^\{d\}\_\{c\}, whose own exponential volume growth matches a tree’s\([Nickel and Kiela, 2017](https://arxiv.org/html/2608.25199#bib.bib1);[Sala et al\., 2018](https://arxiv.org/html/2608.25199#bib.bib6)\)\. In our model, the tree\-structured regularizer is a function of pairwise prototype distances and should therefore be cheaper to satisfy on the hyperbolic manifold than on the Euclidean one without distorting the class\-conditional likelihood\. Whether that geometric advantage realises in practice on a real hierarchical\-classification problem is what we test\. We instantiate the question on WikiArt\-Refined\([Tan et al\., 2019](https://arxiv.org/html/2608.25199#bib.bib4)\), a 27\-style 81,446\-painting corpus where the class hierarchy \(Renaissance branches into Baroque, Baroque into Rococo, Rococo into Romanticism, on into Impressionism and Cubism\) is part of the domain and was hand\-built from standard art\-history references\. Frozen CLIP ViT\-B/16 features\([Radford et al\., 2021](https://arxiv.org/html/2608.25199#bib.bib3)\)feed an MLP head and a prototype classifier; the manifold of the classifier output is the only design choice that varies between Euclidean and hyperbolic runs\. The same tree\-structured regularizer \(a normalised squared\-error pull on the prototype distance matrix\) applies in both geometries\. We sweep regularized maximum\-likelihood fits across 150 seed\-replicated configurations spanning embedding dimensiond∈\{2,4,8,16,32,64\}d\\in\\\{2,4,8,16,32,64\\\}, curvaturec∈\{0\.1,0\.3,1,3\}c\\in\\\{0\.1,0\.3,1,3\\\}, regularizer strengthλ∈\{0,0\.1,0\.3,1,3\}\\lambda\\in\\\{0,0\.1,0\.3,1,3\\\}, and three reference\-tree variants \(default lineage, chronological era grouping, flat null\)\. Three empirical findings emerge\. #### Local hierarchy\. Hyperbolic prototypes recover local tree structure substantially better than matched Euclidean ones\. Sibling recall@5 atd=8d\{=\}8is0\.1950\.195versus0\.1490\.149on the default tree; aggregated over 18 paired seed configurations the mean gap is\+8\.7\+8\.7pp on sibling recall and\+15\.2\+15\.2pp on cousin recall, with sign agreement0\.940\.94and paired\-ttp<10−4p<10^\{\-4\}\. This effect is preserved when sibling sets are redefined from data\-driven empirical trees built either from CLIP or DINOv2\([Oquab et al\., 2024](https://arxiv.org/html/2608.25199#bib.bib9)\)features, and across the regularizer\-strength sweep\. #### Calibration\. A logistic\-regression baseline on raw CLIP features achieves64\.1%64\.1\\%top\-1, statistically tied with the Euclidean fit’s64\.3%64\.3\\%\. Akk\-NN baseline on the same features achieves sibling recall@5 of0\.1600\.160, statistically tied with the Euclidean fit’s0\.1490\.149but3\.53\.5pp below the hyperbolic fit’s0\.1950\.195\. Read against these baselines, the hyperbolic fit is the only one of our trained models that improves the encoder on local hierarchy; the Euclidean fit matches the encoder on classification but adds no detectable structural value over it\. #### Global tree fidelity\. Mean tree distortion against the default tree favours Euclidean significantly, but prototype\-tree Spearman is not significantly different from zero across the full sweep \(p=0\.68p=0\.68\), and the small effect that does appear flips sign between empirical reference trees built from CLIP and from DINOv2 feature centroids\. We therefore do not claim a geometry winner on global tree fidelity\. The clean claim our experiments support is narrower than “geometry matters globally”: hyperbolic latent structure adds local\-retrieval value over the encoder while Euclidean latent structure does not, and that local advantage is robust to which of three reference trees defines “local\.” #### Related work\. Hyperbolic prototype embeddings are an established tool for tree\-shaped data\([Nickel and Kiela, 2017](https://arxiv.org/html/2608.25199#bib.bib1);[Sala et al\., 2018](https://arxiv.org/html/2608.25199#bib.bib6);[Ganea et al\., 2018](https://arxiv.org/html/2608.25199#bib.bib2)\)\.[Khrulkov et al\. \(2020\)](https://arxiv.org/html/2608.25199#bib.bib7)report a similar asymmetry on few\-shot benchmarks \(helps neighborhood structure, leaves top\-1 unchanged\); we confirm that pattern on a hand\-built taxonomy with a tree\-aware regularizer, and quantify it against linear andkk\-NN calibration baselines that previous reports of the same asymmetry do not include\. Tree\-distance\-matrix penalties over learnable points are used implicitly in hyperbolic hierarchical clustering\([Chami et al\., 2020](https://arxiv.org/html/2608.25199#bib.bib8)\); here we use one as an explicit, tunable regularizer\. ## 2Data and reference trees We use WikiArt\-Refined\([Tan et al\., 2019](https://arxiv.org/html/2608.25199#bib.bib4)\),∼\\sim81,446 paintings labelled with one of 27 styles, with the supplied 70/30 train/val split\. The corpus is heavily class\-imbalanced \(133\.3×133\.3\\timesratio between Impressionism with 13,060 examples and Analytical Cubism with 77; full distribution in Appendix[B](https://arxiv.org/html/2608.25199#A2)\)\. Two design choices follow: the prototype classifier has no per\-class bias \(only geometric distance enters the logit\), and we report balanced accuracy alongside top\-1\. #### Reference trees\. WikiArt ships no hierarchy and art\-history offers several credible taxonomies, so we use three\. The*default*tree \([AppendixA](https://arxiv.org/html/2608.25199#A1)\) follows standard art\-historical lineage\. The*chronological*tree groups styles into six era buckets \(Renaissance, Baroque–Rococo, 19th century, early 20th century, modern post\-war, non\-Western\)\. The*flat*tree makes every style a direct child of the root and serves as a deliberate null whose pairwise distances are constant off\-diagonal\. For a treeTTwith leavesu,vu,v, tree distance is the unweighted shortest\-path edge countdT\(u,v\)=depth\(u\)\+depth\(v\)−2depth\(LCA\(u,v\)\)d\_\{T\}\(u,v\)=\\mathrm\{depth\}\(u\)\+\\mathrm\{depth\}\(v\)\-2\\,\\mathrm\{depth\}\(\\mathrm\{LCA\}\(u,v\)\)\. We additionally build two*empirical*reference trees by agglomerative clustering of class\-mean encoder features \([Section4\.2](https://arxiv.org/html/2608.25199#S4.SS2)\): one from CLIP and one from DINOv2, used only for evaluation\. ## 3Model and estimation #### Likelihood model\. Letϕ\\phibe a frozen CLIP ViT\-B/16 encoder\([Radford et al\., 2021](https://arxiv.org/html/2608.25199#bib.bib3)\)andgθ:ℝ512→ℳg\_\{\\theta\}:\\mathbb\{R\}^\{512\}\\to\\mathcal\{M\}a two\-layer MLP with GELU and dropout, where the latent manifoldℳ\\mathcal\{M\}is either Euclideanℝd\\mathbb\{R\}^\{d\}or a Poincaré ball𝔹cd\\mathbb\{B\}^\{d\}\_\{c\}of curvaturec\>0c\>0\. For an imagexxof styley∈\{1,…,K\}y\\in\\\{1,\\ldots,K\\\}, setz=gθ\(ϕ\(x\)\)z=g\_\{\\theta\}\(\\phi\(x\)\), and let\{𝐩k\}k=1K⊂ℳ\\\{\\mathbf\{p\}\_\{k\}\\\}\_\{k=1\}^\{K\}\\subset\\mathcal\{M\}be learnable class prototypes\. The class\-conditional likelihood is a softmax over distance to prototype onℳ\\mathcal\{M\}: p\(y=k∣z;\{𝐩k\}\)∝exp\(−dℳ\(z,𝐩k\)\)\.p\(y=k\\mid z;\\,\\\{\\mathbf\{p\}\_\{k\}\\\}\)\\;\\propto\\;\\exp\\\!\\bigl\(\-d\_\{\\mathcal\{M\}\}\(z,\\mathbf\{p\}\_\{k\}\)\\bigr\)\.The encoder feeds the head identically in both geometries; switching geometries changes exactly two things: the head’s final transform \(identity forℝd\\mathbb\{R\}^\{d\};exp0c\(u\)=tanh\(c‖u‖\)u/\(c‖u‖\)\\exp\_\{0\}^\{c\}\(u\)=\\tanh\(\\sqrt\{c\}\\,\\\|u\\\|\)\\,u/\(\\sqrt\{c\}\\,\\\|u\\\|\)for the ball\) and the metric used by the classifier: dc\(x,y\)=1carcosh\(1\+2c‖x−y‖2\(1−c‖x‖2\)\(1−c‖y‖2\)\)\.d^\{c\}\(x,y\)=\\tfrac\{1\}\{\\sqrt\{c\}\}\\operatorname\{arcosh\}\\\!\\Bigl\(1\+\\tfrac\{2c\\,\\\|x\-y\\\|^\{2\}\}\{\(1\-c\\\|x\\\|^\{2\}\)\(1\-c\\\|y\\\|^\{2\}\)\}\\Bigr\)\.Backbone, MLP width, dropout, batch size, optimiser, and schedule are shared\. #### Tree\-structured regularizer\. We add a tree\-structured regularizer on prototype layouts\. LetDij=dℳ\(𝐩i,𝐩j\)D\_\{ij\}=d\_\{\\mathcal\{M\}\}\(\\mathbf\{p\}\_\{i\},\\mathbf\{p\}\_\{j\}\)be the matrix of pairwise prototype distances onℳ\\mathcal\{M\}andTij=dT\(i,j\)T\_\{ij\}=d\_\{T\}\(i,j\)the tree distance matrix on the reference treeTT\. The regularizer penalises deviation between the*shapes*of these two distance matrices, ℛ\(\{𝐩k\}\)=λ\|𝒫\|∑\(i,j\)∈𝒫\(DijD¯−TijT¯\)2,\\mathcal\{R\}\(\\\{\\mathbf\{p\}\_\{k\}\\\}\)\\;=\\;\\frac\{\\lambda\}\{\|\\mathcal\{P\}\|\}\\sum\_\{\(i,j\)\\in\\mathcal\{P\}\}\\Bigl\(\\tfrac\{D\_\{ij\}\}\{\\bar\{D\}\}\-\\tfrac\{T\_\{ij\}\}\{\\bar\{T\}\}\\Bigr\)^\{\\\!2\},where𝒫\\mathcal\{P\}is the set of\(K2\)\\binom\{K\}\{2\}off\-diagonal pairs,D¯,T¯\\bar\{D\},\\bar\{T\}are the means ofD,TD,T, andλ\\lambdacontrols regularizer strength\. Mean\-normalising each pair before differencing makes the regularizer invariant to the absolute scale of distances onℳ\\mathcal\{M\}: the geometry is free to pick whatever scale the likelihood prefers, while the regularizer constrains only the relative structure of the prototype distance matrix\.λ=0\\lambda=0recovers the cross\-entropy baseline used in prior hyperbolic\-image work\([Khrulkov et al\., 2020](https://arxiv.org/html/2608.25199#bib.bib7)\)\. We treatℛ\\mathcal\{R\}as a penalty rather than a Bayesian log\-prior:ℛ\\mathcal\{R\}is not the log of a normalised density onℳK\\mathcal\{M\}^\{K\}\(it is mean\-rescaled on each evaluation\), so it has no proper\-prior interpretation, and we report regularized maximum\-likelihood estimates rather than MAP estimates of a posterior\. #### Estimation\. We minimise the regularized negative log\-likelihoodℒ\(θ,\{𝐩k\}\)=ℒCE\(θ,\{𝐩k\}\)\+ℛ\(\{𝐩k\}\)\\mathcal\{L\}\(\\theta,\\\{\\mathbf\{p\}\_\{k\}\\\}\)=\\mathcal\{L\}\_\{CE\}\(\\theta,\\\{\\mathbf\{p\}\_\{k\}\\\}\)\+\\mathcal\{R\}\(\\\{\\mathbf\{p\}\_\{k\}\\\}\)by stochastic gradient descent\. Adam optimises the MLP head; Riemannian Adam fromgeoopt\([Kochurov et al\., 2020](https://arxiv.org/html/2608.25199#bib.bib5)\)optimises the hyperbolic prototypes, projecting each update back onto the manifold\. The regularizer is computed once per gradient step over the\(272\)=351\\binom\{27\}\{2\}=351off\-diagonal style pairs, negligible cost next to the per\-batch likelihood term\. The framing makes explicit that the regularizer is a structured penalty on a geometric quantity \(the prototype distance matrix\) and that the choice of latent manifold controls how cheaply that penalty can be driven to zero\. #### Distortion bound\. The regularizer is a function of pairwise prototype distances, so in any latent geometry where the tree distance matrixTTadmits a low\-distortion isometric embedding, the regularizer cost at the optimum is small\. Sala et al\. give distortion bounds∼1/d\\sim 1/dfor𝔹cd\\mathbb\{B\}^\{d\}\_\{c\}versus a constant floor forℝd\\mathbb\{R\}^\{d\}at fixeddd\([Sala et al\., 2018](https://arxiv.org/html/2608.25199#bib.bib6)\)\. The empirical question is whether that asymptotic statement is visible on a real dataset at modestdd, against a real classification likelihood, with a finite\-sample fit rather than an isometric embedding objective\. #### Training details\. 150 runs total; batch size 4096; Adamη=10−3\\eta=10^\{\-3\}for the head and10−210^\{\-2\}for the prototypes; weight decay10−410^\{\-4\}; dropout0\.10\.1; gradient clipping at norm1\.01\.0; 30 epochs\. CLIP features are pre\-cached as float16 tensors, keeping each run under 10 seconds on a single Apple M\-series GPU and the full sweep under half an hour\. Every headline configuration is replicated across three seeds; reported error bars are seed standard deviation\. Significance comparisons across seeds use paired\-tttests on the 18 \(dim, seed\) pairs of the dimension sweep, with hyperbolic configurations selected at the best curvature per pair\. #### Evaluation\. A useful style embedding can be useful along three orthogonal axes, and we report metrics for each\.*Classification*is top\-1, top\-5, and balanced accuracy\.*Global tree fidelity*is the Spearman correlation between the learned prototype distance matrix and the tree distance matrix, plus mean and worst\-case multiplicative distortion\.*Local tree preservation*is sibling and cousin recall@kkamong thekknearest neighbours of each validation embedding, fork∈\{5,10\}k\\in\\\{5,10\\\}\. Sibling/cousin sets are derived from a reference tree; we evaluate against the default, the CLIP\-empirical, and the DINOv2\-empirical tree to test sensitivity \([Sections4\.2](https://arxiv.org/html/2608.25199#S4.SS2)and[4\.5](https://arxiv.org/html/2608.25199#S4.SS5)\)\. ## 4Results Three findings emerge from the 150\-run sweep, summarised here and developed below\. \(i\) Hyperbolic prototypes recover local tree structure substantially better than matched Euclidean ones, robustly across reference\-tree construction \([Section4\.2](https://arxiv.org/html/2608.25199#S4.SS2)\)\. \(ii\) Calibrated against linear andkk\-NN baselines on raw CLIP features, the hyperbolic fit is the only trained model that adds structural value over the encoder; the Euclidean fit matches the encoder on classification but adds nothing on retrieval \([Section4\.3](https://arxiv.org/html/2608.25199#S4.SS3)\)\. \(iii\) The global tree\-fidelity comparison is metric\- and reference\-tree\-dependent and we do not claim a winner there \([Section4\.6](https://arxiv.org/html/2608.25199#S4.SS6)\)\. Figure 1:Prototype layouts atd=2d\{=\}2, best curvature per geometry\. Each large dot is a learned style prototype; small dots are a 600\-image sample of validation embeddings\. The dashed circle on the right marks the Poincaré ball boundary at radius1/c1/\\sqrt\{c\}\. Hyperbolic prototypes settle into a near\-boundary ring \(mean radius0\.5610\.561, std0\.0130\.013across all 27 styles, against a boundary at0\.5770\.577\)\. This is the exponential\-volume regime where the manifold has the capacity for trees\([Nickel and Kiela, 2017](https://arxiv.org/html/2608.25199#bib.bib1);[Sala et al\., 2018](https://arxiv.org/html/2608.25199#bib.bib6)\)\. Euclidean prototypes scatter diffusely with no analogous structural pressure \(mean radius2\.962\.96, std0\.9950\.995\)\. The geometry behaves as theory predicts; the rest of the paper measures whether that geometric difference shows up in downstream metrics\.Table 1:Best Euclidean vs\. best hyperbolic configuration across the dimension and regularizer\-strength sweeps, selected per geometry by mean top\-1 across seeds\. Mean±\\pmseed standard deviation\. Two rightmost columns: logistic regression andkk\-NN\-5 on raw CLIP features \(no learned head, no prototype objective\)\. Euclidean leads classification and global\-tree metrics over hyperbolic prototypes; hyperbolic prototypes lead sibling and cousin recall by44–55pp\. Read against the calibration baselines, the Euclidean fit is tied with logistic on top\-1 and withkk\-NN on sibling recall; only the hyperbolic fit improves onkk\-NN for sibling and cousin recall\.### 4\.1Headline comparison Selecting the best configuration of each geometry by mean top\-1 yields[Table1](https://arxiv.org/html/2608.25199#S4.T1): the two geometries split along a local\-vs\-global axis\. Euclidean leads classification \(top\-1\+5\.3\+5\.3pp, top\-5\+2\.4\+2\.4pp\) and global\-tree Spearman against the default tree \(\+0\.108\+0\.108\); hyperbolic leads sibling recall@5 \(\+0\.052\+0\.052\) and cousin recall@5 \(\+0\.047\+0\.047\)\. The seed bands do not overlap on any of the five metrics\. The remaining subsections show that this split is structural rather than the artifact of any single configuration\. ### 4\.2Local tree structure Figure 2:Metrics versus embedding dimensiondd\(90 runs; three seeds per config; hyperbolic at the best curvature perddper seed\)\. Top\-1 saturates neard=16d\{=\}16for both geometries with Euclidean ahead by44–66pp\. Sibling recall@5 decreases withddfor Euclidean \(from0\.2210\.221atd=2d\{=\}2to0\.1420\.142atd=64d\{=\}64\) but stays nearly flat for hyperbolic, opening a55pp gap byd=64d\{=\}64\.Figure 3:Sibling and cousin recall@5 with relations defined by the default tree \(dashed\) and a CLIP\-derived empirical tree \(solid\), per geometry per embedding dimension\. The hyperbolic lead is preserved under the empirical\-tree redefinition; on sibling recall the gap widens slightly\. The DINOv2\-derived empirical tree is in[AppendixF](https://arxiv.org/html/2608.25199#A6)\.The local\-recall difference is the strongest signal in the sweep\. On the default tree \([Figure2](https://arxiv.org/html/2608.25199#S4.F2)\), hyperbolic sibling recall@5 stays near0\.190\.19acrossd∈\{2,4,8,16,32,64\}d\\in\\\{2,4,8,16,32,64\\\}, while Euclidean sibling recall decreases from0\.2210\.221atd=2d\{=\}2to0\.1420\.142atd=64d\{=\}64\. This monotone divergence with embedding capacity is consistent with the geometric prediction: inℝd\\mathbb\{R\}^\{d\}the distortion of the tree distance matrix grows with the available capacity to spread classes for likelihood, while in𝔹cd\\mathbb\{B\}^\{d\}\_\{c\}the curvature absorbs that pressure\. Aggregated over 18 paired seed configurations \(6 dimensions×\\times3 seeds, hyperbolic at the best curvature per pair\), the mean gap is\+8\.7\+8\.7pp on sibling recall and\+15\.2\+15\.2pp on cousin recall, with sign agreement0\.940\.94on each and paired\-ttp<10−4p<10^\{\-4\}\. The sibling/cousin sets used by recall@5 are themselves a function of which reference tree we use, so a sceptical reading would treat the local advantage as an artifact of the hand\-built tree\. We test this by rebuilding sibling and cousin sets from data\-driven*empirical*trees: agglomerative average\-linkage clustering on class\-mean encoder features, converted to integer\-edge tree distances\.[Figure3](https://arxiv.org/html/2608.25199#S4.F3)shows the comparison against a CLIP\-derived empirical tree; the hyperbolic lead is preserved and slightly larger \(\+6\.0\+6\.0pp atd=8d\{=\}8versus\+4\.6\+4\.6pp on the default tree\)\. Replacing the empirical tree’s construction encoder with DINOv2\([Oquab et al\., 2024](https://arxiv.org/html/2608.25199#bib.bib9)\)replicates the lead at everyd≥4d\\geq 4\(full numbers in[AppendixF](https://arxiv.org/html/2608.25199#A6)\)\. The local advantage of hyperbolic prototypes is reference\-tree independent in the strict sense that it survives three distinct reference\-tree constructions, including two encoder\-derived ones that share no construction step with the hand\-built tree\. ### 4\.3Calibration baselines Figure 4:Top\-1 accuracy versus sibling recall@5 for every sweep configuration\. Marker size scales with the regularizer strengthλ\\lambda\. Vertical dotted line: logistic\-regression top\-1 on raw CLIP features \(64\.1%64\.1\\%\)\. Black star:kk\-NN\-5 on raw CLIP features \(sibling recall0\.1600\.160\)\. The Euclidean cluster sits at or below the encoder baseline on retrieval; only the hyperbolic cluster populates the upper region of the plot\.A reader cannot judge a65\.9%65\.9\\%top\-1 number without external calibration\. Two reference classifiers train directly on raw frozen CLIP features, with no learned head and no prototype objective: logistic regression andkk\-NN\-5\. Logistic regression achieves64\.1%64\.1\\%top\-1 and61\.1%61\.1\\%balanced accuracy;kk\-NN achieves63\.5%63\.5\\%top\-1,58\.8%58\.8\\%balanced accuracy, and sibling recall@5 of0\.160/0\.3660\.160/0\.366on default\-tree / CLIP\-empirical\-tree relations\. Read against these baselines: the best Euclidean configuration \(65\.9%65\.9\\%top\-1\) beats logistic regression by1\.81\.8pp; on balanced accuracy it underperforms \(55\.4%55\.4\\%vs\.61\.1%61\.1\\%\)\. Best\-top\-1 Euclidean’s sibling recall@5 is0\.1360\.136, below thekk\-NN baseline of0\.1600\.160\. The best\-top\-1 hyperbolic configuration \(60\.6%60\.6\\%top\-1\) sits2\.92\.9pp belowkk\-NN on classification but2\.82\.8pp above it on sibling recall \(0\.1880\.188vs\.0\.1600\.160\)\. Atd=8d\{=\}8specifically, hyperbolic sibling recall@5 reaches0\.1950\.195on the default tree and0\.4160\.416on the empirical tree, against thekk\-NN baseline’s0\.160/0\.3660\.160/0\.366\.[Figure4](https://arxiv.org/html/2608.25199#S4.F4)plots the full top\-1\-vs\-sibling\-recall scatter: the Euclidean cluster sits wherekk\-NN already lives; only hyperbolic configurations populate the upper region\. On this dataset and encoder, the hyperbolic fit is the only trained model that adds local\-structural value over the encoder\. ### 4\.4Regularizer strength Figure 5:Top\-1, prototype\-tree Spearman, and sibling recall@5 versus regularizer strengthλ\\lambdaatd=8d\{=\}8,c=1c\{=\}1\(three seeds per point\)\. The regularizer drives tree\-Spearman from∼0\.3\\sim 0\.3to∼0\.7\\sim 0\.7in both geometries, but classification collapses forλ≥1\\lambda\\geq 1\. The hyperbolic top\-1 gap never closes; sibling recall is stable for hyperbolic across allλ\\lambda, while for Euclidean it rises only at the largest testedλ\\lambda, where classification has already collapsed\. Mean tree distortion \(omitted here for legibility\) decreases uniformly withλ\\lambdain both geometries; full four\-panel version in[AppendixD](https://arxiv.org/html/2608.25199#A4)\.The relative ordering of the two geometries is preserved across the regularizer\-strength sweepλ∈\{0,0\.1,0\.3,1,3\}\\lambda\\in\\\{0,0\.1,0\.3,1,3\\\}atd∈\{8,16\}d\\in\\\{8,16\\\},c=1c\{=\}1\([Figure5](https://arxiv.org/html/2608.25199#S4.F5)\)\. Atλ=0\.1\\lambda\{=\}0\.1the regularizer Pareto\-improves both: Euclideand=8d\{=\}8top\-1 rises0\.70\.7pp to65\.0%65\.0\\%while tree\-Spearman rises from0\.2920\.292to0\.3450\.345; hyperbolic gains a fraction of a point on top\-1 and22pp on sibling recall\. Atλ=3\\lambda\{=\}3both geometries reach tree\-Spearman≈0\.7\\approx 0\.7but classification collapses \(Euclidean46\.9%46\.9\\%, hyperbolic37\.4%37\.4\\%\): the regularizer succeeds at the metric it was constructed to optimise, at substantial likelihood cost\. The Euclidean top\-1 lead and the hyperbolic sibling\-recall lead persist at everyλ\\lambdatested\. ### 4\.5Training\-tree and class\-imbalance robustness Figure 6:Each geometry trained withλ=1\\lambda\{=\}1atd=8d\{=\}8against three different reference trees, then evaluated against the default tree\. Bars are seed means; whiskers are seed standard deviation\. Tree\-Spearman against the default tree collapses for non\-default training trees; the regularizer only helps the metric anchored to the training tree\. The geometry winner does not change on any panel: Euclidean wins top\-1 on every tree, hyperbolic wins sibling recall on every tree\. Full four\-panel version including mean tree distortion in[AppendixE](https://arxiv.org/html/2608.25199#A5)\.Re\-training each geometry against the chronological and flat reference trees \(withd=8d\{=\}8,c=1c\{=\}1,λ=1\\lambda\{=\}1, evaluated against the default tree throughout\) does not change the geometry winner on any panel: Euclidean wins top\-1 on every training tree, hyperbolic wins sibling recall on every training tree \([Figure6](https://arxiv.org/html/2608.25199#S4.F6)\)\. Inverse\-frequency class\-weighted training preserves the geometry gap on every metric we report \(top\-1 remains55pp Euclidean, sibling recall remains44pp hyperbolic;[AppendixG](https://arxiv.org/html/2608.25199#A7)\)\. Substituting DINOv2 features into the empirical\-tree construction reverses the direction of the small global\-Spearman gap but preserves the hyperbolic local\-recall lead on every reference tree \([AppendixF](https://arxiv.org/html/2608.25199#A6)\)\. ### 4\.6Global tree fidelity is unstable The third finding is partly a negative result\. Aggregated paired\-tttests over the full dimension sweep givep=0\.68p=0\.68for class\-center / default\-tree Spearman and a sign agreement of exactly0\.500\.50\. The small headline gap \(ρEu−ρHy≈0\.108\\rho\_\{\\textrm\{Eu\}\}\-\\rho\_\{\\textrm\{Hy\}\}\\approx 0\.108in[Table1](https://arxiv.org/html/2608.25199#S4.T1)\) is therefore selecting a noisy outlier through best\-of\-sweep\. Mean tree distortion does favour Euclidean significantly \(\+0\.040\+0\.040,p<10−4p<10^\{\-4\}\), so the two natural global\-fidelity metrics disagree about which geometry wins\. Replacing the hand\-built reference with a CLIP\-derived empirical tree reverses the Spearman direction at everyd≥4d\\geq 4\(hyperbolic ahead by\+0\.01\+0\.01to\+0\.05\+0\.05\); replacing the empirical tree’s construction encoder with DINOv2 reverses it back \(Euclidean ahead by up to\+0\.06\+0\.06\)\. Hand\-built and encoder\-derived trees correlate only weakly \(ρ≈0\.08,0\.12\\rho\\approx 0\.08,0\.12on pairwise distances\); CLIP\-empirical and DINOv2\-empirical correlate0\.500\.50\. Across all four reference\-tree constructions we tried, the only stable claim about global tree fidelity is that the comparison is not stable\. The local claim survives every variation\. ## 5Discussion The clean finding is that, in our tree\-regularized prototype model on a real hierarchical\-classification problem, the latent manifold has a local effect on tree fidelity even when its global effect is unstable\. Hyperbolic prototype geometry is the only one of our trained models that meaningfully improves on the frozen encoder for local hierarchy preservation\. Sibling recall@5 atd=8d\{=\}8is0\.1950\.195for hyperbolic,0\.1490\.149for Euclidean, and0\.1600\.160forkk\-NN\-5 on raw CLIP features: the Euclidean fit is tied with the encoder; the hyperbolic fit improves on it by3\.53\.5pp\. The advantage holds when sibling sets are redefined from data\-driven empirical trees built from CLIP or DINOv2 features, and aggregates to\+8\.7\+8\.7pp on sibling and\+15\.2\+15\.2pp on cousin recall over the full dimension sweep with paired\-ttp<10−4p<10^\{\-4\}\. The classification gap is real but uninformative about geometry\. A logistic\-regression head on raw CLIP features achieves64\.1%64\.1\\%top\-1, which the Euclidean fit matches atd=8d\{=\}8\(64\.3%64\.3\\%\) and the hyperbolic fit underperforms by44–66pp\. Neither fit is doing meaningful classification work that a linear head on the same features cannot; the difference between the two fits on this axis is best read as “Euclidean prototype distances do not distort classification beyond what the encoder already supports, while hyperbolic prototype distances do\.” The global tree\-fidelity comparison is the place where careful framing matters most\. Mean tree distortion favours Euclidean significantly against the default tree; class\-center / tree Spearman is not significantly different from zero across the sweep \(p=0\.68p=0\.68\); the small global\-Spearman gap reverses sign between empirical reference trees built from CLIP and from DINOv2 feature centroids\. “Either geometry wins on global tree fidelity” is not a claim our experiments support\. Sibling and cousin recall favour hyperbolic on every reference tree we tried\. #### Limitations\. We cannot generalise beyond medium\-scale, Western\-canon\-heavy WikiArt with a frozen CLIP\-ViT\-B/16 encoder for training; the local advantage we identify may not survive a fine\-tuned encoder or a hierarchy substantially deeper than the2727\-leaf taxonomy used here\. We cannot conclude that the hyperbolic geometry does substantive work inside the head MLP, since only the prototypes live on the manifold\. #### Extensions\. Three natural follow\-ups in increasing cost\. A genuinely hyperbolic head along the lines of Möbius layers\([Ganea et al\., 2018](https://arxiv.org/html/2608.25199#bib.bib2)\)would let the manifold shape the representation rather than only the decision boundary, and is the cheapest test of whether the classification gap closes\. The empirical reference trees in this paper are built in Euclidean space from encoder features\. Building one in hyperbolic space, or by direct tree\-learning methods\([Chami et al\., 2020](https://arxiv.org/html/2608.25199#bib.bib8)\), would close a remaining circularity\. Replication on a deeper hierarchy \(iNaturalist with WordNet, or a fine\-grained subdivision of WikiArt’s largest classes\) would test the limits of the local advantage we observe\. ## Broader impact The system itself is small \(a 27\-way classifier on cached features\), but a few of its design choices have implications worth being explicit about\. The default reference tree is built from a Western, lineage\-based art\-history canon\. Every metric in this paper that mentions “the hierarchy” is anchored to that taxonomy, which is implicitly endorsed by anyone using the numbers\. Our tree\-variant experiments are partial mitigation: they document how much each conclusion depends on the choice of tree\. A deployment in a museum or classroom should treat the tree as configuration, not as a constant\. WikiArt is heavily biased toward European painting; the corpus has 27 styles but only one \(Ukiyo\-e\) sits outside the European\-and\-American canon, and East Asian ink\-painting traditions that span centuries are collapsed into that single label\. A retrieval system trained on this data will under\-rank non\-Western works for ambiguous queries\. Hyperbolic geometry, which tightens local neighborhoods, could compound the effect by making those already\-tight neighborhoods more confident\. We therefore do not recommend deploying hyperbolic style embeddings for attribution or authentication tasks without expert human review:5050–65%65\\%top\-1 accuracy over2727well\-known styles is far below the threshold any serious provenance, insurance, or legal decision should require\. ## Acknowledgements This work used Anthropic’s Claude \(Opus 4\.7\) as a research assistant\. Specifically, the model assisted with code scaffolding for experimental infrastructure \(sweep orchestration, plotting helpers, figure generation\), with brainstorming and concept clarification during analysis, and with preliminary drafts of prose that the authors substantially revised\. All experimental design choices, the selection of hypotheses to test, hyperparameter ranges, ground\-truth tree definitions, result interpretations, and the final text of this manuscript reflect the authors’ substantial original contribution\. ## References - Chamiet al\.\(2020\)I\. Chami, A\. Gu, V\. Chatziafratis, and C\. RéFrom trees to continuous embeddings and back: hyperbolic hierarchical clustering\.InAdvances in Neural Information Processing Systems,Vol\.33\.Cited by:[§1](https://arxiv.org/html/2608.25199#S1.SS0.SSS0.Px4.p1.1),[§5](https://arxiv.org/html/2608.25199#S5.SS0.SSS0.Px2.p1.1)\. - Ganeaet al\.\(2018\)O\. Ganea, G\. Bécigneul, and T\. HofmannHyperbolic neural networks\.InAdvances in Neural Information Processing Systems,Vol\.31\.Cited by:[§1](https://arxiv.org/html/2608.25199#S1.SS0.SSS0.Px4.p1.1),[§5](https://arxiv.org/html/2608.25199#S5.SS0.SSS0.Px2.p1.1)\. - Khrulkovet al\.\(2020\)V\. Khrulkov, L\. Mirvakhabova, E\. Ustinova, I\. Oseledets, and V\. LempitskyHyperbolic image embeddings\.InIEEE/CVF Conference on Computer Vision and Pattern Recognition \(CVPR\),Cited by:[§1](https://arxiv.org/html/2608.25199#S1.SS0.SSS0.Px4.p1.1),[§3](https://arxiv.org/html/2608.25199#S3.SS0.SSS0.Px2.p1.2)\. - Kochurovet al\.\(2020\)M\. Kochurov, R\. Karimov, and S\. KozlukovGeoopt: Riemannian optimization in PyTorch\.InICML 2020 Workshop on Graph Representation Learning and Beyond \(GRL\+\),Note:arXiv:2005\.02819Cited by:[§3](https://arxiv.org/html/2608.25199#S3.SS0.SSS0.Px3.p1.1)\. - Nickel and Kiela \(2017\)M\. Nickel and D\. KielaPoincaré embeddings for learning hierarchical representations\.InAdvances in Neural Information Processing Systems,Vol\.30\.Cited by:[§1](https://arxiv.org/html/2608.25199#S1.SS0.SSS0.Px4.p1.1),[§1](https://arxiv.org/html/2608.25199#S1.p2.1),[Figure 1](https://arxiv.org/html/2608.25199#S4.F1),[Figure 1](https://arxiv.org/html/2608.25199#S4.F1.4)\. - Oquabet al\.\(2024\)M\. Oquab, T\. Darcet, T\. Moutakanni, H\. Vo, M\. Szafraniec, V\. Khalidov, P\. Fernandez, D\. Haziza, F\. Massa, A\. El\-Nouby, M\. Assran, N\. Ballas, W\. Galuba, R\. Howes, P\. Huang, S\. Li, I\. Misra, M\. Rabbat, V\. Sharma, G\. Synnaeve, H\. Xu, H\. Jégou, J\. Mairal, P\. Labatut, A\. Joulin, and P\. BojanowskiDINOv2: learning robust visual features without supervision\.Transactions on Machine Learning Research\.Note:arXiv:2304\.07193Cited by:[§1](https://arxiv.org/html/2608.25199#S1.SS0.SSS0.Px1.p1.1),[§4\.2](https://arxiv.org/html/2608.25199#S4.SS2.p2.1)\. - Radfordet al\.\(2021\)A\. Radford, J\. W\. Kim, C\. Hallacy, A\. Ramesh, G\. Goh, S\. Agarwal, G\. Sastry, A\. Askell, P\. Mishkin, J\. Clark,et al\.Learning transferable visual models from natural language supervision\.InProceedings of the 38th International Conference on Machine Learning,pp\. 8748–8763\.Cited by:[§1](https://arxiv.org/html/2608.25199#S1.p3.1),[§3](https://arxiv.org/html/2608.25199#S3.SS0.SSS0.Px1.p1.1)\. - Salaet al\.\(2018\)F\. Sala, C\. De Sa, A\. Gu, and C\. RéRepresentation tradeoffs for hyperbolic embeddings\.InProceedings of the 35th International Conference on Machine Learning,pp\. 4460–4469\.Cited by:[§1](https://arxiv.org/html/2608.25199#S1.SS0.SSS0.Px4.p1.1),[§1](https://arxiv.org/html/2608.25199#S1.p2.1),[§3](https://arxiv.org/html/2608.25199#S3.SS0.SSS0.Px4.p1.1),[Figure 1](https://arxiv.org/html/2608.25199#S4.F1),[Figure 1](https://arxiv.org/html/2608.25199#S4.F1.4)\. - Tanet al\.\(2019\)W\. R\. Tan, C\. S\. Chan, H\. Aguirre, and K\. TanakaImproved ArtGAN for conditional synthesis of natural image and artwork\.InIEEE Transactions on Image Processing,Vol\.28,pp\. 394–409\.Cited by:[§1](https://arxiv.org/html/2608.25199#S1.p1.1),[§1](https://arxiv.org/html/2608.25199#S1.p3.1),[§2](https://arxiv.org/html/2608.25199#S2.p1.1)\. ## Appendix ADefault style hierarchy The default reference tree, hand\-built from standard art\-history references and used as the primary evaluation reference throughout the paper\. ``` Root |-- Early_Renaissance | |-- Northern_Renaissance | ‘-- High_Renaissance | ‘-- Mannerism_Late_Renaissance | ‘-- Baroque | ‘-- Rococo | ‘-- Romanticism | |-- Realism | | |-- Contemporary_Realism | | ‘-- Impressionism | | ‘-- Post_Impressionism | | |-- Pointillism | | |-- Fauvism | | ‘-- Cubism | | |-- Analytical_Cubism | | ‘-- Synthetic_Cubism | ‘-- Symbolism | |-- Art_Nouveau | ‘-- Expressionism | ‘-- Abstract_Expressionism | |-- Action_painting | |-- Color_Field_Painting | ‘-- Minimalism |-- Pop_Art | ‘-- New_Realism |-- Ukiyo_e ‘-- Naive_Art_Primitivism ``` ## Appendix BClass distribution and tree\-distance matrices Figure 7:Per\-style image counts on WikiArt\-Refined\. Impressionism dominates with13,06013\{,\}060examples; Analytical Cubism, Action Painting, and Synthetic Cubism each have fewer than250250\. The imbalance ratio between extrema is133\.3×133\.3\\times\.Figure 8:Tree distance matrices for the three reference hierarchies used in this paper: default lineage \(left\), chronological era grouping \(centre\), flat null \(right\)\. Rows and columns are styles in the same order across panels\. ## Appendix CCurvature within the hyperbolic family The body[Figure2](https://arxiv.org/html/2608.25199#S4.F2)shows the dimension scaling for both geometries; here we add detail on curvature\. Sweep configuration: geometry×\\timesd∈\{2,4,8,16,32,64\}d\\in\\\{2,4,8,16,32,64\\\}×\\timesc∈\{0\.1,0\.3,1,3\}c\\in\\\{0\.1,0\.3,1,3\\\}for hyperbolic, three seeds\. Within the hyperbolic family, curvature interpolates between the two extremes: higherccpulls prototypes closer to the boundary of the disk, where the Poincaré metric becomes most curved; this exchanges22–33pp of top\-1 for44–55pp of sibling recall\. Atd=8d\{=\}8, the optimalccfor top\-1 is0\.30\.3\(59\.8%59\.8\\%\) and the optimalccfor sibling recall is3\.03\.0\(0\.2300\.230\)\. This is consistent with how hyperbolic capacity is distributed: most volume lies near the boundary, where the leaves of a tree should live\. ## Appendix DRegularizer\-strength sweep, full panel set Figure 9:Full four\-panel version of the regularizer\-strength sweep \(body[Figure5](https://arxiv.org/html/2608.25199#S4.F5)drops the third panel for legibility\)\. Mean tree distortion decreases monotonically withλ\\lambdain both geometries, mirroring the rise in tree\-Spearman\. ## Appendix ETraining\-tree ablation, full panel set The body[Figure6](https://arxiv.org/html/2608.25199#S4.F6)summarises the three\-tree ablation; the underlying observation is that training against a tree other than the evaluation tree provides essentially no useful hierarchical signal: tree\-Spearman against the default tree drops to≈0\.14\\approx 0\.14for both non\-default training trees, and top\-1 climbs back to theλ=0\\lambda\{=\}0baseline because the regularizer no longer competes with the likelihood\. Figure 10:Full four\-panel version of the training\-tree ablation \(body[Figure6](https://arxiv.org/html/2608.25199#S4.F6)drops the third panel for legibility\)\. Tree distortion against the default tree is uniformly higher when training against a non\-default tree\. ## Appendix FEmpirical reference trees and DINOv2 cross\-encoder Figure 11:Prototype\-distance / tree\-distance Spearman against the hand\-built default tree \(blue\) and a CLIP\-empirical tree \(red\)\. Both geometries’ prototypes align substantially better with the empirical tree than with the hand\-built one\. Caveat: the empirical tree is built in Euclidean space from the same CLIP features used to train the prototypes, so the alignment with prototype distances is partly expected by construction\. The geometry comparison is the load\-bearing claim, not the absolute level\.Figure 12:Substituting a DINOv2 ViT\-B/14 encoder for CLIP in the empirical\-tree construction\.Left:prototype\-tree Spearman against three references\. The hyperbolic global\-Spearman lead seen against the CLIP\-empirical tree does not replicate against the DINOv2\-empirical tree: Euclidean prototypes lead at everyd≥4d\\geq 4\.Centre:sibling recall@5 against the three reference\-tree sibling\-set definitions\. Hyperbolic leads on every reference at everyd≥4d\\geq 4\.Right:pairwise\-distance Spearman between reference trees\. Hand\-built correlates only weakly with either encoder\-derived tree \(0\.080\.08,0\.120\.12\); the two encoder\-derived trees correlate0\.500\.50with each other\.#### Tree\-vs\-tree\. Pairwise\-distance Spearman between hand\-built default and CLIP\-empirical is0\.080\.08; between default and DINOv2\-empirical it is0\.120\.12; between CLIP\-empirical and DINOv2\-empirical it is0\.500\.50\. Whatever the hand\-built lineage tree captures, the encoders see only a weak projection of it; whatever the encoders capture, they capture it similarly\. The hand\-built tree is the outlier\. #### Empirical sibling and cousin recall\. Sibling/cousin sets used by recall@5 in the body figures are derived fromSTYLE\_HIERARCHY\(the default tree\)\. To test reference\-tree sensitivity we rebuild sibling and cousin sets from each empirical tree’s binary linkage \(siblings: the leaves in the other branch of the leaf’s first merge; cousins: the leaves in the uncle subtree at the grandparent merge\) and rerun the recall computation\. The hyperbolic lead is preserved on every reference tree \(sibling recall@5 atd=8d\{=\}8, default / CLIP\-empirical / DINOv2\-empirical: Eu0\.149/0\.356/0\.3220\.149/0\.356/0\.322, Hy0\.195/0\.416/0\.3800\.195/0\.416/0\.380\)\. #### Global\-Spearman direction is encoder\-specific\. Against the DINOv2\-empirical tree, Euclidean prototypes lead at everyd≥4d\\geq 4, withρEu−ρHy\\rho\_\{\\textrm\{Eu\}\}\-\\rho\_\{\\textrm\{Hy\}\}growing to\+0\.06\+0\.06atd=64d\{=\}64\(0\.4130\.413vs\.0\.3570\.357\)\. This is a negative result for the strongest reading of the CLIP\-empirical finding and motivates the global\-fidelity caveat in the body\. ## Appendix GClass\-imbalance robustness WikiArt is heavily skewed \(Impressionism has133×133\\timesmore training examples than Action Painting\)\. The default sweep uses unweighted cross\-entropy; rerunning thed=8d\{=\}8winners of each geometry with inverse\-frequency class\-weighted cross\-entropy \(three seeds\) shifts absolute numbers as expected \(top\-1 drops by roughly66pp for both: Eu64\.3→58\.3%64\.3\\to 58\.3\\%, Hy59\.8→53\.4%59\.8\\to 53\.4\\%; while balanced accuracy rises sharply: Eu56\.4→65\.6%56\.4\\to 65\.6\\%, Hy44\.5→62\.1%44\.5\\to 62\.1\\%\), but the geometry gap is preserved on every axis\. Top\-1 remains55pp Euclidean, sibling recall remains44pp hyperbolic, and class\-center / tree Spearman shifts by less than a hundredth\. The balanced\-accuracy gap narrows from11\.911\.9to3\.53\.5pp, suggesting hyperbolic’s main classification weakness in the default setup was disproportionately on rare classes; it remains in Euclidean’s favour\. ## Appendix HConfusion structure Figure 13:Row\-normalized confusion matrices atd=8d\{=\}8, with rows and columns permuted by a depth\-first traversal of the default style tree so that hierarchically adjacent styles sit next to each other on both axes\. Both models concentrate mistakes in near\-diagonal blocks: errors predominantly fall on tree\-adjacent styles\. The hyperbolic block structure is visibly softer near the diagonal: more confusion mass spreads into immediate siblings, less mass jumps to distant styles\. This is the same fact the sibling\-recall numbers report, in a form a viewer can absorb at a glance\. ## Appendix IReproducibility The full sweep CSV records, for every config, the training hyperparameters and every evaluation metric \(150 rows\)\. To reproduce: ``` python scripts/sweep.py --phase 1 --device mps # ~14 min, 90 configs python scripts/sweep.py --phase 2 --device mps # ~10 min, 48 configs python scripts/sweep.py --phase 3 --device mps # ~3 min, 18 configs python scripts/baselines.py # logreg, kNN baselines python scripts/significance.py # paired-t, sign tests python scripts/make_figures.py # regenerate figures ``` Code, sweep configurations, and exact metric implementations are available at[https://github\.com/pgrindehollevik\-harvard/hyperbolic](https://github.com/pgrindehollevik-harvard/hyperbolic)\.
Similar Articles
Neural Collapse by Design: Learning Class Prototypes on the Hypersphere
This paper shows that cross-entropy and supervised contrastive learning are both forms of prototype learning on the hypersphere and proposes normalized losses (NTCE and NONL) that achieve Neural Collapse by design, outperforming standard methods.
Topological Simplification in Predictive Coding Networks
The paper studies the topology of learned representations in predictive coding networks using persistent homology, finding that smaller models simplify topology earlier than larger ones and that earlier simplification correlates with worse reconstruction performance.
Topology-Enhanced Alignment for Large Language Models: Trajectory Topology Loss and Topological Preference Optimization
This paper introduces a topology-enhanced alignment framework for LLMs, utilizing trajectory topology loss and topological preference optimization based on persistent homology to regularize semantic trajectories in hidden space.
Geometry of Semantic Space: Comparative Study of Discrete and Continuous Models
This paper compares the geometric structures induced by deep learning vector embeddings (CamemBERT) and lexical co-occurrence graph models on the French 'Great National Debate' corpus, finding similar local topology but distinct global organization, highlighting complementarity between the two approaches.
Topology-Preserving Neural Operator Learning via Hodge Decomposition
This paper proposes a topology-preserving neural operator learning method using Hodge decomposition to separate topological and geometric components, improving accuracy and efficiency on geometric meshes.