基于Sheaf SyncMap的稳定无监督连续分块
摘要
本文引入sheaf正则化以稳定去中心化SyncMap用于无监督连续分块,实现更高的归一化互信息和对输入分布偏移的更好适应。
arXiv:2609.25143v1 Announce Type: new
Abstract: Unsupervised Continual chunking is a fundamental problem in machine learning and neuroscience, where the goal is to identify groups of states that frequently co-occur in temporal sequences. A key challenge is to form accurate chunks while maintaining their stability over time. In this work, we propose sheaf regularization to reduce local inconsistencies in Decentralized SyncMap, a self-organizing system, and thereby stabilize its chunking dynamics. We introduce a radial sheaf structure that penalizes distance-dependent radial motion between pairs of variables. Experimental results show that the proposed method achieves the highest normalized mutual information (NMI) among the evaluated SyncMap variants on 12 of 18 probabilistic Continual General Chunking Problem (CGCP) graphs with two-state memory and on 17 of 18 graphs with dynamic memory. In the sequential adaptation experiment, Sheaf SyncMap also achieves high NMI after shifts in the input distribution, indicating that it can adapt to new knowledge while avoiding the negative transfer commonly observed in modern machine learning systems such as neural networks.
查看缓存全文
缓存时间: 2026/09/23 09:26
# Stable Unsupervised Continual Chunking with Sheaf SyncMap
Source: [https://arxiv.org/html/2609.25143](https://arxiv.org/html/2609.25143)
###### Abstract
Unsupervised Continual chunking is a fundamental problem in machine learning and neuroscience, where the goal is to identify groups of states that frequently co\-occur in temporal sequences\. A key challenge is to form accurate chunks while maintaining their stability over time\. In this work, we propose sheaf regularization to reduce local inconsistencies in Decentralized SyncMap, a self\-organizing system, and thereby stabilize its chunking dynamics\. We introduce a radial sheaf structure that penalizes distance\-dependent radial motion between pairs of variables\. Experimental results show that the proposed method achieves the highest normalized mutual information \(NMI\) among the evaluated SyncMap variants on 12 of 18 probabilistic Continual General Chunking Problem \(CGCP\) graphs with two\-state memory and on 17 of 18 graphs with dynamic memory\. In the sequential adaptation experiment, Sheaf SyncMap also achieves high NMI after shifts in the input distribution, indicating that it can adapt to new knowledge while avoiding the negative transfer commonly observed in modern machine learning systems such as neural networks\.
Keywords:self\-organization, sheaf theory, non\-backpropagation learning
## 1Introduction
Self\-organization is a fascinating phenomenon widely observed in nature, in which complex structures emerge from simple interactions among individual components\[[1](https://arxiv.org/html/2609.25143#bib.bib6),[2](https://arxiv.org/html/2609.25143#bib.bib7),[3](https://arxiv.org/html/2609.25143#bib.bib8)\]\. Unlike many conventional engineered structures, which remain largely fixed after construction, self\-organized biological structures can continuously reorganize in response to environmental changes\. Examples include living bridges formed by army ants, mechanically adaptive clusters formed by honeybees, and transport networks formed by slime mold\[[4](https://arxiv.org/html/2609.25143#bib.bib9),[5](https://arxiv.org/html/2609.25143#bib.bib10),[6](https://arxiv.org/html/2609.25143#bib.bib11)\]\. This ability to maintain functionality through decentralized adaptation motivates us to pursue self\-organization as a principle for building robust and flexible artificial systems\. A fundamental challenge, however, is how to preserve previously formed global structures when individual components have access only to limited local observations that do not explicitly encode those structures\.
SyncMap is a self\-organizing system that recognizes co\-occurring patterns in temporal sequences and encodes them as spatially chunked representations in an unsupervised manner\[[7](https://arxiv.org/html/2609.25143#bib.bib1)\]\. It can reorganize itself based on current observations, mimicking the adaptive behavior of biological systems\. Standard SyncMap divides all variables into positive and negative groups, whose members are attracted to and repelled from their respective group centers\. However, the standard SyncMap tends to collapse variables toward their corresponding centers, thereby losing local information within each chunk\. Decentralized SyncMap replaces the two group centers with pairwise forces, preserving more local structure than center\-based updates\[[8](https://arxiv.org/html/2609.25143#bib.bib2)\]\. Despite this advantage, the limited observation window causes unobserved variables that have already formed a chunk to experience substantial repulsion, causing the chunk to spread and eventually vanish\.
Recently, sheaf theory has attracted increasing attention in the machine learning community\[[9](https://arxiv.org/html/2609.25143#bib.bib13),[10](https://arxiv.org/html/2609.25143#bib.bib14),[11](https://arxiv.org/html/2609.25143#bib.bib12)\]\. It provides a mathematical framework for resolving global inconsistencies by reducing local conflicts\. Specifically, it assigns vector spaces to vertices and edges, defines restriction maps between them, and iteratively updates the vertex data to reduce local inconsistencies\[[12](https://arxiv.org/html/2609.25143#bib.bib4),[13](https://arxiv.org/html/2609.25143#bib.bib3)\]\. In this work, we propose a sheaf regularization method to stabilize the chunking dynamics of Decentralized SyncMap\. We introduce a radial sheaf structure that penalizes radial motion between pairs of variables based on their distance and repeller status\. Experimental results show that the chunk structure in Decentralized SyncMap with sheaf regularization vanishes significantly more slowly\. We also propose a directional history repulsion mechanism that stabilizes the sequential chunking dynamics by distinguishing interactions between positive and negative variables from those between pairs of positive variables and pairs of negative variables\.
Figure 1:Overview of Sheaf SyncMap\. Left panel: The number of chunks is greater than the number of variables per chunk\. Without our regularization, variables that interact with other chunks become entangled, preventing the formation of correct chunks\. Right panel: The number of chunks is smaller than the number of variables per chunk\. Without our regularization, the variables being observed collapse to a single point, while the other chunks expand and eventually vanish\. Sheaf regularization stabilizes the chunking dynamics in both cases\.
## 2Related Work
### 2\.1Decentralized SyncMap
The original formulation, referred to here as standard SyncMap, updates the position of each variable based on its interaction with the positive and negative centers:
xi,t\+1=xi,t\+α\(ϕi,t\(cpt−xi,t\)\|cpt−xi,t\|−\(1−ϕi,t\)\(cnt−xi,t\)\|cnt−xi,t\|\),x\_\{i,t\+1\}=x\_\{i,t\}\+\\alpha\\left\(\\frac\{\\phi\_\{i,t\}\(cp\_\{t\}\-x\_\{i,t\}\)\}\{\|cp\_\{t\}\-x\_\{i,t\}\|\}\-\\frac\{\(1\-\\phi\_\{i,t\}\)\(cn\_\{t\}\-x\_\{i,t\}\)\}\{\|cn\_\{t\}\-x\_\{i,t\}\|\}\\right\),\(1\)wherexi,tx\_\{i,t\}is the position of variableiiat timett,α\\alphais the adaptation rate, andcptcp\_\{t\}andcntcn\_\{t\}are the positive and negative centers at timett, respectively:
cpt=∑i∈PStxi,t\|PSt\|,cnt=∑i∈NStxi,t\|NSt\|,cp\_\{t\}=\\frac\{\\sum\_\{i\\in PS\_\{t\}\}x\_\{i,t\}\}\{\\left\|PS\_\{t\}\\right\|\},\\qquad cn\_\{t\}=\\frac\{\\sum\_\{i\\in NS\_\{t\}\}x\_\{i,t\}\}\{\\left\|NS\_\{t\}\\right\|\},\(2\)wherePStPS\_\{t\}andNStNS\_\{t\}are the sets of variables in the positive and negative groups at timett, respectively\. Variables in the positive group are called attractors, whereas variables in the negative group are called repellers\. The indicator functionϕi,t\\phi\_\{i,t\}is defined as:
ϕi,t=\{1,i∈PSt,0,i∈NSt\.\\phi\_\{i,t\}=\\begin\{cases\}1,&i\\in PS\_\{t\},\\\\ 0,&i\\in NS\_\{t\}\.\\end\{cases\}\(3\)During the learning process, the attractors are attracted toward the positive center, whereas the repellers are repelled from the negative center\. One of the main weaknesses of the original SyncMap is that variables tend to move toward their corresponding centers and eventually collapse to nearly the same position, thereby losing local information within each chunk\[[7](https://arxiv.org/html/2609.25143#bib.bib1)\]\. We also use Symmetrical SyncMap as a second center\-based baseline, which has better performance than Standard SyncMap on imbalanced CGCPs\[[14](https://arxiv.org/html/2609.25143#bib.bib15)\]\.
Decentralized SyncMap replaces the two group centers with pairwise forces\[[8](https://arxiv.org/html/2609.25143#bib.bib2)\]\. LetNNrepresent the number of variables, and let𝐯t∈\{0,1\}N\\mathbf\{v\}\_\{t\}\\in\\\{0,1\\\}^\{N\}denote whether each variable currently belongs to the positive or negative group \(1 for positive, 0 for negative\)\. We refer to𝐯t\\mathbf\{v\}\_\{t\}as the activation state\. Therefore,𝐯¯t=𝟏−𝐯t\\bar\{\\mathbf\{v\}\}\_\{t\}=\\mathbf\{1\}\-\\mathbf\{v\}\_\{t\}, and
𝐏t=𝐯t𝐯t⊤∈ℝN×N,𝐌t=𝐯¯t𝐯¯t⊤∈ℝN×N,dij,t=‖𝐱i,t−𝐱j,t‖2∈ℝ\.\\mathbf\{P\}\_\{t\}=\\mathbf\{v\}\_\{t\}\\mathbf\{v\}\_\{t\}^\{\\top\}\\in\\mathbb\{R\}^\{N\\times N\},\\qquad\\mathbf\{M\}\_\{t\}=\\bar\{\\mathbf\{v\}\}\_\{t\}\\bar\{\\mathbf\{v\}\}\_\{t\}^\{\\top\}\\in\\mathbb\{R\}^\{N\\times N\},\\qquad d\_\{ij,t\}=\\\|\\mathbf\{x\}\_\{i,t\}\-\\mathbf\{x\}\_\{j,t\}\\\|\_\{2\}\\in\\mathbb\{R\}\.\(4\)Here,Pij,tP\_\{ij,t\}selects attractor–attractor pairs at timett, whereasMij,tM\_\{ij,t\}selects repeller–repeller pairs\. Their attraction and repulsion magnitudes are
aij,t=Cij,t\(1\+γ\+e−dij,t/r\+\),rij,t=Mij,tγ−e−dij,t/r−\+μHHij,t,a\_\{ij,t\}=C\_\{ij,t\}\\left\(1\+\\gamma\_\{\+\}e^\{\-d\_\{ij,t\}/r\_\{\+\}\}\\right\),\\qquad r\_\{ij,t\}=M\_\{ij,t\}\\gamma\_\{\-\}e^\{\-d\_\{ij,t\}/r\_\{\-\}\}\+\\mu\_\{H\}H\_\{ij,t\},\(5\)whereCij,t≥0C\_\{ij,t\}\\geq 0combines the current interactions between attractors with recency\-weighted attractor history\. The first term ofrij,tr\_\{ij,t\}represents instantaneous repulsion from repellers, whereasHij,tH\_\{ij,t\}stores persistent repeller history weighted by a factorμH\\mu\_\{H\}\.
For the original symmetric history rule, this memory evolves elementwise as
𝐇~t\\displaystyle\\widetilde\{\\mathbf\{H\}\}\_\{t\}=clip\[0,1\]\(𝐇t−1\+TH−1𝐌t\),\\displaystyle=\\operatorname\{clip\}\_\{\[0,1\]\}\\left\(\\mathbf\{H\}\_\{t\-1\}\+T\_\{H\}^\{\-1\}\\mathbf\{M\}\_\{t\}\\right\),\(6\)𝐇t\\displaystyle\\mathbf\{H\}\_\{t\}=\(𝟏𝟏⊤−𝐏t\)⊙𝐇~t\.\\displaystyle=\\left\(\\mathbf\{1\}\\mathbf\{1\}^\{\\top\}\-\\mathbf\{P\}\_\{t\}\\right\)\\odot\\widetilde\{\\mathbf\{H\}\}\_\{t\}\.\(7\)A repeller pair therefore accumulates1/TH1/T\_\{H\}for each co\-repelling step, up to a maximum of one, and its memory is cleared when both endpoints become attractors\. A stored attractor–repeller entry remains active because it is neither accumulated by𝐌t\\mathbf\{M\}\_\{t\}nor cleared by𝐏t\\mathbf\{P\}\_\{t\}\.
The coordinate update is given by the sum of all pairwise forces:
𝐮i,t=∑j≠i𝐱i,t−𝐱j,tdij,t\(βrij,t−αaij,t\),𝐱i,t\+1=𝐱i,t\+η𝐮i,t,\\mathbf\{u\}\_\{i,t\}=\\sum\_\{j\\neq i\}\\frac\{\\mathbf\{x\}\_\{i,t\}\-\\mathbf\{x\}\_\{j,t\}\}\{d\_\{ij,t\}\}\\left\(\\beta r\_\{ij,t\}\-\\alpha a\_\{ij,t\}\\right\),\\qquad\\mathbf\{x\}\_\{i,t\+1\}=\\mathbf\{x\}\_\{i,t\}\+\\eta\\mathbf\{u\}\_\{i,t\},\(8\)followed by global coordinate normalization\. Although pairwise updates preserve local structure better than center\-based updates, unconstrained relative motion can still cause chunking instabilities such as expansion, contraction, and breathing\. This limitation motivates the sheaf regularization introduced below\.
### 2\.2Cellular Sheaf
A sheaf is a mathematical framework that provides a way to resolve global inconsistencies by reducing local conflicts\[[12](https://arxiv.org/html/2609.25143#bib.bib4)\]\. A cellular sheaf extends graph theory by applying sheaf theory to graphs, thereby enabling more complex interactions between vertices and edges\[[13](https://arxiv.org/html/2609.25143#bib.bib3)\]\. A standard graphG=\(V,E\)G=\(V,E\), whereVVis the set of vertices andEEis the set of edges, only specifies whetheru,v∈Vu,v\\in Vare connected by an edgee∈Ee\\in E\. By introducing a cellular sheafℱ\\mathcal\{F\}, we can assign a vector spaceℱ\(v\)\\mathcal\{F\}\(v\)to each vertexvvand a vector spaceℱ\(e\)\\mathcal\{F\}\(e\)to each edgeee\. These vector spaces are called stalks\. If data samplesxu∈ℱ\(u\)x\_\{u\}\\in\\mathcal\{F\}\(u\)andxv∈ℱ\(v\)x\_\{v\}\\in\\mathcal\{F\}\(v\)are assigned to two neighboring verticesuuandvvconnected by an edgeee, their relationship is described by the restriction mapsℱu⊴e\\mathcal\{F\}\_\{u\\trianglelefteq e\}andℱv⊴e\\mathcal\{F\}\_\{v\\trianglelefteq e\}:
ℱv⊴e:ℱ\(v\)→ℱ\(e\),ℱu⊴e:ℱ\(u\)→ℱ\(e\)\.\\displaystyle\\mathcal\{F\}\_\{v\\trianglelefteq e\}:\\mathcal\{F\}\(v\)\\to\\mathcal\{F\}\(e\),\\quad\\mathcal\{F\}\_\{u\\trianglelefteq e\}:\\mathcal\{F\}\(u\)\\to\\mathcal\{F\}\(e\)\.\(9\)These maps specify how information is mapped from vertices to edges\. Ifxux\_\{u\}andxvx\_\{v\}satisfy the consistency condition
ℱv⊴e\(xv\)=ℱu⊴e\(xu\),\\mathcal\{F\}\_\{v\\trianglelefteq e\}\(x\_\{v\}\)=\\mathcal\{F\}\_\{u\\trianglelefteq e\}\(x\_\{u\}\),\(10\)then\(xu,xv\)\(x\_\{u\},x\_\{v\}\)forms a section over the edge\. If a collection of vectors satisfies the consistency condition for all edges in the graph, it forms a global section of the sheaf\. The strainses\_\{e\}is defined as follows to quantify local inconsistency:
se=\(δx\)e=ℱv⊴e\(xv\)−ℱu⊴e\(xu\),s\_\{e\}=\(\\delta x\)\_\{e\}=\\mathcal\{F\}\_\{v\\trianglelefteq e\}\(x\_\{v\}\)\-\\mathcal\{F\}\_\{u\\trianglelefteq e\}\(x\_\{u\}\),\(11\)whereδ\\deltais the coboundary operator of the sheaf\. We use implicit sheaf\-Laplacian diffusion to update the data associated with each vertex:
xk\+1=\(I\+ηL\)−1xk,L=δ⊤δ,x\_\{k\+1\}=\(I\+\\eta L\)^\{\-1\}x\_\{k\},\\qquad L=\\delta^\{\\top\}\\delta,\(12\)thereby reducing local inconsistencies and promoting global consistency\.
### 2\.3Continual General Chunking Problem
The Continual General Chunking Problem \(CGCP\) was first proposed in\[[7](https://arxiv.org/html/2609.25143#bib.bib1)\]\. It provides a unified formulation for several problems studied in neuroscience and computer science, including chunking, causal and temporal community detection, and unsupervised feature learning from temporal sequences\. CGCP aims to identify groups of states that frequently co\-occur in temporal sequences while allowing the underlying data\-generation process, or data structure, to change over time\. The input sequence is generated by a random walk on a graph, where transitions between states follow a first\-order Markov chain\.
For our experiments, we synthesize 18 probabilistic CGCP graphs, each corresponding to a factor pair satisfyingKM=600KM=600, with3≤K≤1203\\leq K\\leq 120chunks and5≤M≤2005\\leq M\\leq 200variables per chunk; thus, every graph hasN=600N=600variables\. The graph nameprobabilisticKK\_MMrecords these values; for example,probabilistic120\_5contains 120 chunks of five variables\. Each chunk forms a complete subgraph without self\-loops, and its last variable links to the first variable of every chunk, keeping the full graph connected\. Trajectories are random walks over outgoing neighbors\. Each visited state is represented by a one\-hot vector, and state memory forms an activation vector from the Boolean union of a recent window\. We use eitherm=2m=2states \(current and previous\) ormdyn=⌊min\(30,max\(2,0\.1N\)\)⌋=30m\_\{\\mathrm\{dyn\}\}=\\lfloor\\min\(30,\\max\(2,0\.1N\)\)\\rfloor=30\.
### 2\.4Mutual Information
We use Normalized Mutual Information \(NMI\) to evaluate the quality of chunking results\[[15](https://arxiv.org/html/2609.25143#bib.bib5)\]\. Consider two random variablesXXandYY\. Their mutual informationI\(X,Y\)I\(X;Y\)is defined as:
I\(X,Y\)=∑x,yp\(x,y\)logp\(x,y\)p\(x\)p\(y\)\.I\(X;Y\)=\\sum\_\{x,y\}p\(x,y\)\\log\\frac\{p\(x,y\)\}\{p\(x\)p\(y\)\}\.\(13\)To normalize the mutual information with respect to the entropies ofXXandYY, NMI is defined as:
NMI\(X,Y\)=2I\(X,Y\)H\(X\)\+H\(Y\)\.\\text\{NMI\}\(X;Y\)=\\frac\{2I\(X;Y\)\}\{H\(X\)\+H\(Y\)\}\.\(14\)The NMI value ranges from 0 to 1, with a larger value indicating greater similarity between the two clusterings\. NMI can therefore be used to evaluate the similarity between a predicted clustering and the ground\-truth clustering\. It is invariant to permutations of cluster labels, meaning that two identical clusterings receive the same NMI score even if their cluster labels are different\. We obtain the predicted clustering by applying DBSCAN to each recorded embedding\[[16](https://arxiv.org/html/2609.25143#bib.bib16)\]\. DBSCAN uses a neighborhood radiusϵ\\epsilonand a minimum neighborhood size,min\_samples\. Selectingϵ\\epsilonby maximizing NMI against the ground\-truth labels gives an oracle density\-scale evaluation because the labels determine the clustering scale\.
## 3Methodology
### 3\.1Directional history repulsion
The pairwise temporal memory of repellers proposed in\[[8](https://arxiv.org/html/2609.25143#bib.bib2)\]is defined in[Eq\.6](https://arxiv.org/html/2609.25143#S2.E6)\. The term\(𝟏𝟏⊤−𝐏t\)\\left\(\\mathbf\{1\}\\mathbf\{1\}^\{\\top\}\-\\mathbf\{P\}\_\{t\}\\right\)in[Eq\.7](https://arxiv.org/html/2609.25143#S2.E7)clears the bidirectional memory of all attractor–attractor pairs\. To incorporate sequential information, we propose clearing only the directional memory associated with the currently activated attractor\. For instance, suppose the observed transition is from variableiito variablejj\. In this case, only the memory entryHij,tH\_\{ij,t\}is set to zero, whileHji,tH\_\{ji,t\}is preserved\. Therefore,[Eq\.7](https://arxiv.org/html/2609.25143#S2.E7)is modified as follows:
𝐇t=\(𝟏𝟏⊤−eiej⊤\)⊙𝐇~t\.\\mathbf\{H\}\_\{t\}=\\left\(\\mathbf\{1\}\\mathbf\{1\}^\{\\top\}\-e\_\{i\}e\_\{j\}^\{\\top\}\\right\)\\odot\\widetilde\{\\mathbf\{H\}\}\_\{t\}\.\(15\)Here,eie\_\{i\}andeje\_\{j\}are the one\-hot vectors corresponding to variablesiiandjj, respectively\. However, the pairwise history\-repulsion term used in[Eq\.5](https://arxiv.org/html/2609.25143#S2.E5)must remain symmetric\. Therefore, we re\-symmetrize the history\-repulsion matrix before computing the pairwise forces:
𝐇teff=𝐇t\+𝐇t⊤2\.\\mathbf\{H\}^\{\\text\{eff\}\}\_\{t\}=\\frac\{\\mathbf\{H\}\_\{t\}\+\\mathbf\{H\}\_\{t\}^\{\\top\}\}\{2\}\.\(16\)
### 3\.2Radial Sheaf SyncMap
In this work, we propose a radial sheaf structure to regularize the pairwise forces in Decentralized SyncMap\. It acts as a regularizer to prevent chunks from expanding and eventually disappearing by suppressing pairwise radial velocities\. Intuitively, it reduces the overall pairwise radial velocity while preserving the original velocity as much as possible \([Fig\.2](https://arxiv.org/html/2609.25143#S3.F2)\)\. Therefore, it can help resist chunk expansion or collapse\.
Figure 2:Intuition of the radial sheaf structure, where the arrows represent the directions in which the variables are moving\. It suppresses the radial velocity between variables while leaving their velocities unchanged when they move together in the same radial direction\.Each variable is associated with a node of the sheaf, and the edge setEEcontains all unordered pairs of variables\. The regularizer therefore applies relative radial geometry to every pair\. The stalk of nodeiiis defined as
ℱ\(i\)=ℝd\_model,\\mathcal\{F\}\(i\)=\\mathbb\{R\}^\{\\text\{d\\\_model\}\},\(17\)whered\_modelis the dimensionality of the SyncMap embedding space\. In this work we set it to 3\. Each node stalk stores the velocity of the corresponding variable\. The edge stalk represents the relative radial velocity between two variables\. Therefore, the strainses\_\{e\}associated with edgee=\(i,j\)e=\(i,j\)is naturally defined as
qe=xi−xj∥xi−xj∥2,se\(v\)=qe⊤\(vi−vj\),q\_\{e\}=\\frac\{x\_\{i\}\-x\_\{j\}\}\{\\lVert x\_\{i\}\-x\_\{j\}\\rVert^\{2\}\},\\qquad s\_\{e\}\(v\)=q\_\{e\}^\{\\top\}\(v\_\{i\}\-v\_\{j\}\),\(18\)whereqeq\_\{e\}is the distance\-weighted radial direction between the two nodes, andviv\_\{i\}denotes the candidate corrected velocity of nodeii\. The sheaf\-Laplacian regularization is designed to reduce radial strain while keeping the modified velocity close to the original proposed velocity\. Mathematically, the objective function𝒥\(v\)\\mathcal\{J\}\(v\)is defined as
si\\displaystyle s\_\{i\}=\{S,iis a repeller,1,iis not a repeller,\\displaystyle=\\begin\{cases\}S,&i\\text\{ is a repeller\},\\\\ 1,&i\\text\{ is not a repeller\},\\end\{cases\}\(19\)ωe\\displaystyle\\omega\_\{e\}=si\+sj2⋅b1−∥xi−xj∥,\\displaystyle=\\frac\{s\_\{i\}\+s\_\{j\}\}\{2\}\\cdot b^\{1\-\\lVert x\_\{i\}\-x\_\{j\}\\rVert\},\(20\)𝒥\(v\)\\displaystyle\\mathcal\{J\}\(v\)=12∥v−p∥F2\+λ2∑e∈Eωese\(v\)2\.\\displaystyle=\\frac\{1\}\{2\}\\lVert v\-p\\rVert\_\{F\}^\{2\}\+\\frac\{\\lambda\}\{2\}\\sum\_\{e\\in E\}\\omega\_\{e\}s\_\{e\}\(v\)^\{2\}\.\(21\)The repeller scaling factorsis\_\{i\}is introduced to regularize repellers more strongly than attractors\. When a repeller interacts with an attractor, the term\(si\+sj\)/2\(s\_\{i\}\+s\_\{j\}\)/2in[Eq\.20](https://arxiv.org/html/2609.25143#S3.E20)produces an intermediate weight between those of attractor–attractor and repeller–repeller pairs\. The first term in[Eq\.21](https://arxiv.org/html/2609.25143#S3.E21)keeps the modified velocityvvclose to the original proposed velocitypp, whereas the second term penalizes radial inconsistency\. The hyperparameterλ\\lambdacontrols the trade\-off between these two terms\. We then define the sheaf coboundary operatorB∈ℝ\|E\|×Nd\_modelB\\in\\mathbb\{R\}^\{\|E\|\\times N\\text\{d\\\_model\}\}\. For an edgee=\(i,j\)e=\(i,j\),
\(Bv\)e=qe⊤vi−qe⊤vj=qe⊤\(vi−vj\)=se\(v\),\(Bv\)\_\{e\}=q\_\{e\}^\{\\top\}v\_\{i\}\-q\_\{e\}^\{\\top\}v\_\{j\}=q\_\{e\}^\{\\top\}\(v\_\{i\}\-v\_\{j\}\)=s\_\{e\}\(v\),\(22\)wherev=\(v1,v2,…,vN\)⊤∈ℝNd\_modelv=\(v\_\{1\},v\_\{2\},\\ldots,v\_\{N\}\)^\{\\top\}\\in\\mathbb\{R\}^\{N\\text\{d\\\_model\}\}contains the velocities of all nodes\. LetWWdenote the diagonal matrix of edge weightsωe\\omega\_\{e\}\. Minimizing[Eq\.21](https://arxiv.org/html/2609.25143#S3.E21)yields
\(I\+λB⊤WB\)v~=p,\\left\(I\+\\lambda B^\{\\top\}WB\\right\)\\widetilde\{v\}=p,\(23\)whereB⊤WBB^\{\\top\}WBis the radial sheaf LaplacianLℱL\_\{\\mathcal\{F\}\}\. SinceλLℱ\\lambda L\_\{\\mathcal\{F\}\}is positive semidefinite,I\+λLℱI\+\\lambda L\_\{\\mathcal\{F\}\}is positive definite, and therefore the solutionv~\\widetilde\{v\}is unique\. In this work, we solve[Eq\.23](https://arxiv.org/html/2609.25143#S3.E23)using the conjugate gradient \(CG\) method\. We initialize the solution withv~0=p\\widetilde\{v\}\_\{0\}=pand compute the residual at iterationttas
rt=p−\(I\+λLℱ\)v~t\.r\_\{t\}=p\-\(I\+\\lambda L\_\{\\mathcal\{F\}\}\)\\widetilde\{v\}\_\{t\}\.\(24\)CG iteratively constructs conjugate search directions from the residuals and updatesv~t\\widetilde\{v\}\_\{t\}using an analytically determined step size\. This procedure produces a corrected velocityv~\\widetilde\{v\}that remains close to the original proposed velocityppwhile reducing radial strain, thereby improving the stability of the chunking dynamics\.
### 3\.3Chunking Instability Score
We measure chunk expanding and contracting by the root\-mean\-square log change in the intra\-chunk mean pairwise distance\. For a ground\-truth chunkCC, the mean pairwise distance at recorded framettis
DC\(t\)=2nC\(nC−1\)∑i<ji,j∈C∥xi\(t\)−xj\(t\)∥2,D\_\{C\}^\{\(t\)\}=\\frac\{2\}\{n\_\{C\}\(n\_\{C\}\-1\)\}\\sum\_\{\\begin\{subarray\}\{c\}i<j\\\\ i,j\\in C\\end\{subarray\}\}\\lVert x\_\{i\}^\{\(t\)\}\-x\_\{j\}^\{\(t\)\}\\rVert\_\{2\},\(25\)wherenCn\_\{C\}is the number of variables inCC, andxi\(t\)x\_\{i\}^\{\(t\)\}is the position of variableii\. We aggregate the changes over all chunks and consecutive recorded frames as
BRMS=1G\(T−1\)∑g=1G∑t=2T\(logDg\(t\)Dg\(t−1\)\)2,B\_\{\\mathrm\{RMS\}\}=\\sqrt\{\\frac\{1\}\{G\(T\-1\)\}\\sum\_\{g=1\}^\{G\}\\sum\_\{t=2\}^\{T\}\\left\(\\log\\frac\{D\_\{g\}^\{\(t\)\}\}\{D\_\{g\}^\{\(t\-1\)\}\}\\right\)^\{2\}\},\(26\)whereGGis the number of ground\-truth chunks andTTis the number of recorded coordinate frames\. A score ofBRMS=0B\_\{\\mathrm\{RMS\}\}=0indicates constant mean pairwise distances across recorded frames; lower values therefore indicate less frame\-to\-frame breathing\.
## 4Experiment
We evaluate Sheaf, Decentralized, Symmetrical, and Standard SyncMap on the 18 probabilistic CGCP graphs with two\-state and dynamic memory\. Each run uses an 80,000\-state trajectory and a three\-dimensional embedding; removing the initial singleton state leaves 79,999 updates\. For each graph and memory setting, seeds 0–4 generate five trajectories\. All methods share the trajectory for each seed, while each method’s initialization is fixed across seeds; we report the mean±\\pmsample standard deviation\. Baseline hyperparameters follow\[[8](https://arxiv.org/html/2609.25143#bib.bib2)\]\. Sheaf SyncMap usesλ=1\\lambda=1,b=10b=10, andS=200S=200, fixed across graphs and seeds without graph\-specific tuning\. Coordinates are recorded every 100 updates, producing 799 frames\. NMI uses DBSCAN withmin\_samples=2\. We computeBRMSB\_\{\\mathrm\{RMS\}\}from the ground\-truth chunks over all recorded frames\. In the adaptation experiments, the final embedding coordinates and model state from each graph are used to initialize the next graph in the sequence\. Because this work focuses on how sheaf regularization stabilizes chunking dynamics, we restrict comparisons to methods within the SyncMap family\.
## 5Results and Discussion
We first compare chunking performance on independent CGCP graphs under two state\-memory settings and then evaluate sequential adaptation when the embedding coordinates and model state are transferred between graphs\. We interpret NMI together with the chunking instability scoreBRMSB\_\{\\mathrm\{RMS\}\}to distinguish accurate chunk formation from embeddings that are stable but poorly aligned with the ground\-truth chunks\.
### 5\.1Independent CGCP Chunking Performance
[Tables1](https://arxiv.org/html/2609.25143#S5.T1)and[2](https://arxiv.org/html/2609.25143#S5.T2)report NMI on the independent CGCP graphs with 2\-state and dynamic state memory, respectively\. With 2\-state memory, Sheaf SyncMap obtains the highest mean NMI of 0\.9663\. Under dynamic state memory, the separation between Sheaf SyncMap and the baselines is larger\. Sheaf SyncMap achieves the highest mean NMI of 0\.9793, compared with 0\.7608 for Decentralized SyncMap, and obtains the highest score on 17 of the 18 graphs\. The only graph on which Sheaf SyncMap does not obtain the highest score isprobabilistic3\_200, where Decentralized SyncMap reaches 0\.9382 and Sheaf SyncMap reaches 0\.8999\. These results show that Sheaf SyncMap maintains high NMI across the two evaluated memory settings, with its largest advantage under dynamic memory and on graphs containing many small chunks\.
GraphSheafSyncMapDecentralizedSyncMapSymmetricalSyncMapStandardSyncMap\(state memory:2\)\(state memory:2\)\(state memory:2\)\(state memory:2\)probabilistic120\_50\.9332±0\.0132\\pm\\,0\.01320\.8670±0\.0247\\pm\\,0\.02470\.0825±0\.1177\\pm\\,0\.11770\.5661±0\.0030\\pm\\,0\.0030probabilistic100\_60\.9693±0\.0061\\pm\\,0\.00610\.9207±0\.0039\\pm\\,0\.00390\.0673±0\.0734\\pm\\,0\.07340\.5389±0\.0019\\pm\\,0\.0019probabilistic75\_80\.9980±0\.0013\\pm\\,0\.00130\.9643±0\.0026\\pm\\,0\.00260\.3558±0\.0819\\pm\\,0\.08190\.5007±0\.0018\\pm\\,0\.0018probabilistic60\_101\.0000±0\.0000\\pm\\,0\.00000\.9861±0\.0031\\pm\\,0\.00310\.5795±0\.0552\\pm\\,0\.05520\.4751±0\.0018\\pm\\,0\.0018probabilistic50\_121\.0000±0\.0000\\pm\\,0\.00000\.9992±0\.0010\\pm\\,0\.00100\.6748±0\.0644\\pm\\,0\.06440\.4530±0\.0008\\pm\\,0\.0008probabilistic40\_151\.0000±0\.0000\\pm\\,0\.00001\.0000±0\.0000\\pm\\,0\.00000\.6902±0\.0614\\pm\\,0\.06140\.4245±0\.0026\\pm\\,0\.0026probabilistic30\_201\.0000±0\.0000\\pm\\,0\.00001\.0000±0\.0000\\pm\\,0\.00000\.7827±0\.0447\\pm\\,0\.04470\.3891±0\.0009\\pm\\,0\.0009probabilistic25\_241\.0000±0\.0000\\pm\\,0\.00001\.0000±0\.0000\\pm\\,0\.00000\.8525±0\.0559\\pm\\,0\.05590\.3734±0\.0018\\pm\\,0\.0018probabilistic24\_251\.0000±0\.0000\\pm\\,0\.00001\.0000±0\.0000\\pm\\,0\.00000\.8120±0\.0524\\pm\\,0\.05240\.3736±0\.0025\\pm\\,0\.0025probabilistic20\_301\.0000±0\.0000\\pm\\,0\.00001\.0000±0\.0000\\pm\\,0\.00000\.8628±0\.0683\\pm\\,0\.06830\.3430±0\.0027\\pm\\,0\.0027probabilistic15\_401\.0000±0\.0000\\pm\\,0\.00001\.0000±0\.0000\\pm\\,0\.00000\.8985±0\.0318\\pm\\,0\.03180\.3114±0\.0014\\pm\\,0\.0014probabilistic12\_501\.0000±0\.0000\\pm\\,0\.00001\.0000±0\.0000\\pm\\,0\.00001\.0000±0\.0000\\pm\\,0\.00000\.2821±0\.0010\\pm\\,0\.0010probabilistic10\_600\.9992±0\.0014\\pm\\,0\.00141\.0000±0\.0000\\pm\\,0\.00000\.9864±0\.0162\\pm\\,0\.01620\.2584±0\.0013\\pm\\,0\.0013probabilistic8\_750\.9931±0\.0154\\pm\\,0\.01541\.0000±0\.0000\\pm\\,0\.00000\.9683±0\.0189\\pm\\,0\.01890\.2344±0\.0012\\pm\\,0\.0012probabilistic6\_1000\.9708±0\.0363\\pm\\,0\.03630\.9739±0\.0348\\pm\\,0\.03480\.9845±0\.0169\\pm\\,0\.01690\.1977±0\.0010\\pm\\,0\.0010probabilistic5\_1200\.8555±0\.1060\\pm\\,0\.10600\.9113±0\.0994\\pm\\,0\.09940\.7772±0\.1691\\pm\\,0\.16910\.1693±0\.0012\\pm\\,0\.0012probabilistic4\_1500\.8949±0\.0701\\pm\\,0\.07010\.9148±0\.0692\\pm\\,0\.06920\.4980±0\.4909\\pm\\,0\.49090\.1408±0\.0010\\pm\\,0\.0010probabilistic3\_2000\.7798±0\.1032\\pm\\,0\.10320\.8238±0\.1268\\pm\\,0\.12680\.5060±0\.4759\\pm\\,0\.47590\.1090±0\.0007\\pm\\,0\.0007Mean Score0\.96630\.96450\.68770\.3411Best count121220
Table 1:NMI scores for the independent CGCP graphs with 2\-state memory\. Values are the mean±\\pmsample standard deviation over five seeds\. Bold values mark the highest mean NMI for each graph, including ties\. The final two rows report the mean score across all 18 graphs and the number of graphs on which each method achieves the highest mean\. Higher values indicate better chunking performance\.GraphSheafSyncMapDecentralizedSyncMapSymmetricalSyncMapStandardSyncMap\(state memory:dynamic\)\(state memory:dynamic\)\(state memory:dynamic\)\(state memory:dynamic\)probabilistic120\_50\.8656±0\.0070\\pm\\,0\.00700\.4376±0\.0086\\pm\\,0\.00860\.0051±0\.0049\\pm\\,0\.00490\.5649±0\.0058\\pm\\,0\.0058probabilistic100\_60\.8990±0\.0097\\pm\\,0\.00970\.4297±0\.0147\\pm\\,0\.01470\.0049±0\.0040\\pm\\,0\.00400\.5304±0\.0065\\pm\\,0\.0065probabilistic75\_80\.9816±0\.0089\\pm\\,0\.00890\.4708±0\.0120\\pm\\,0\.01200\.0047±0\.0050\\pm\\,0\.00500\.4911±0\.0048\\pm\\,0\.0048probabilistic60\_100\.9974±0\.0026\\pm\\,0\.00260\.5250±0\.0243\\pm\\,0\.02430\.0068±0\.0054\\pm\\,0\.00540\.4577±0\.0056\\pm\\,0\.0056probabilistic50\_120\.9988±0\.0015\\pm\\,0\.00150\.5604±0\.0131\\pm\\,0\.01310\.0082±0\.0048\\pm\\,0\.00480\.4432±0\.0021\\pm\\,0\.0021probabilistic40\_151\.0000±0\.0001\\pm\\,0\.00010\.6218±0\.0198\\pm\\,0\.01980\.0063±0\.0060\\pm\\,0\.00600\.4129±0\.0045\\pm\\,0\.0045probabilistic30\_200\.9999±0\.0001\\pm\\,0\.00010\.6930±0\.0179\\pm\\,0\.01790\.0098±0\.0044\\pm\\,0\.00440\.3770±0\.0038\\pm\\,0\.0038probabilistic25\_241\.0000±0\.0000\\pm\\,0\.00000\.7271±0\.0161\\pm\\,0\.01610\.0050±0\.0011\\pm\\,0\.00110\.3656±0\.0074\\pm\\,0\.0074probabilistic24\_251\.0000±0\.0000\\pm\\,0\.00000\.7354±0\.0306\\pm\\,0\.03060\.0031±0\.0030\\pm\\,0\.00300\.3626±0\.0030\\pm\\,0\.0030probabilistic20\_301\.0000±0\.0000\\pm\\,0\.00000\.7893±0\.0251\\pm\\,0\.02510\.0019±0\.0023\\pm\\,0\.00230\.3394±0\.0048\\pm\\,0\.0048probabilistic15\_401\.0000±0\.0000\\pm\\,0\.00000\.9125±0\.0077\\pm\\,0\.00770\.0023±0\.0018\\pm\\,0\.00180\.3033±0\.0061\\pm\\,0\.0061probabilistic12\_501\.0000±0\.0000\\pm\\,0\.00000\.9689±0\.0098\\pm\\,0\.00980\.0027±0\.0018\\pm\\,0\.00180\.2777±0\.0058\\pm\\,0\.0058probabilistic10\_601\.0000±0\.0000\\pm\\,0\.00000\.9895±0\.0062\\pm\\,0\.00620\.0449±0\.0566\\pm\\,0\.05660\.2577±0\.0052\\pm\\,0\.0052probabilistic8\_751\.0000±0\.0000\\pm\\,0\.00000\.9980±0\.0021\\pm\\,0\.00210\.0788±0\.1731\\pm\\,0\.17310\.2460±0\.0065\\pm\\,0\.0065probabilistic6\_1001\.0000±0\.0000\\pm\\,0\.00000\.9844±0\.0301\\pm\\,0\.03010\.2676±0\.2597\\pm\\,0\.25970\.2268±0\.0086\\pm\\,0\.0086probabilistic5\_1201\.0000±0\.0000\\pm\\,0\.00000\.9422±0\.1125\\pm\\,0\.11250\.3740±0\.3461\\pm\\,0\.34610\.2316±0\.0405\\pm\\,0\.0405probabilistic4\_1500\.9845±0\.0215\\pm\\,0\.02150\.9707±0\.0635\\pm\\,0\.06350\.6596±0\.1286\\pm\\,0\.12860\.2325±0\.0611\\pm\\,0\.0611probabilistic3\_2000\.8999±0\.0911\\pm\\,0\.09110\.9382±0\.1158\\pm\\,0\.11580\.5366±0\.3041\\pm\\,0\.30410\.2886±0\.0976\\pm\\,0\.0976Mean Score0\.97930\.76080\.11240\.3560Best count17100
Table 2:NMI scores for the independent CGCP graphs with dynamic state memory\. Values are the mean±\\pmsample standard deviation over five seeds\. Bold values mark the highest mean NMI for each graph, including ties\. The final two rows report the mean score across all 18 graphs and the number of graphs on which each method achieves the highest mean\. Higher values indicate better chunking performance\.
### 5\.2Sequential Adaptation Experiments
To evaluate sequential adaptation, we train each method on random walks from five probabilistic CGCP graphs in succession\. The final embedding coordinates and model state from one graph initialize the next stage, so each stage transition changes the graph without resetting the learned representation\. In[Fig\.3](https://arxiv.org/html/2609.25143#S5.F3), Sheaf SyncMap recovers high NMI after every transition: it approaches 1\.0 in the first four stages and remains near 0\.95 on the finalprobabilistic4\_150graph\. Its performance exceeds that of Decentralized SyncMap during the first three stages and becomes comparable during the final two stages\. This recovery supports the interpretation that sheaf regularization does not permanently lock the embedding to the structure learned from the preceding graph\.
[Figure4](https://arxiv.org/html/2609.25143#S5.F4)also shows that Sheaf SyncMap generally produces less frame\-to\-frame breathing than Decentralized SyncMap throughout the sequence\. The high NMI and reduced breathing relative to other SyncMap variants indicate that sheaf regularization stabilizes chunking dynamics without preventing adaptation to a new graph\.
Figure 3:NMI during sequential adaptation across five CGCP graphs; each stage label gives the number of chunks×\\timesthe number of variables per chunk\. Lines show the mean over four seeds, shaded regions show the sample standard deviation, and vertical dotted lines mark graph transitions\. Each stage is initialized with the final embedding coordinates and model state from the preceding graph\. Higher values indicate better chunking performance\.Figure 4:Local chunking instability scoreBRMS\(t\)B\_\{\\mathrm\{RMS\}\}\(t\)during sequential adaptation across five CGCP graphs; each stage label gives the number of chunks×\\timesthe number of variables per chunk\. Lines show the mean over four seeds, shaded regions show the sample standard deviation, and vertical dotted lines mark graph transitions\. Each stage is initialized with the final embedding coordinates and model state from the preceding graph\. Lower values indicate less frame\-to\-frame breathing\.
### 5\.3Sheaf Behavior Analysis
We report the percentages of the overall velocity magnitude and radial\-inconsistency magnitude retained after sheaf regularization, which are given by
100∥v~t∥F∥vt∥F,100Et\(v~t\)Et\(vt\)\.100\\frac\{\\lVert\\widetilde\{v\}\_\{t\}\\rVert\_\{F\}\}\{\\lVert v\_\{t\}\\rVert\_\{F\}\},\\qquad 100\\sqrt\{\\frac\{E\_\{t\}\(\\widetilde\{v\}\_\{t\}\)\}\{E\_\{t\}\(v\_\{t\}\)\}\}\.\(27\)whereEt\(vt\)=∑e∈Eωese\(vt\)2E\_\{t\}\(v\_\{t\}\)=\\sum\_\{e\\in E\}\\omega\_\{e\}s\_\{e\}\(v\_\{t\}\)^\{2\}is the weighted squared radial\-inconsistency measure, andv~t\\widetilde\{v\}\_\{t\}is the sheaf\-regularized velocity\.[Figure5](https://arxiv.org/html/2609.25143#S5.F5)shows that the retained radial\-inconsistency magnitude is lower than the retained overall velocity magnitude by a factor of approximately1010–100100, indicating that sheaf regularization suppresses radial inconsistency more strongly than would uniform velocity rescaling\.
Figure 5:Velocity magnitude retained after sheaf regularization under dynamic state memory\. Gray bars show the retained overall velocity magnitude, whereas blue bars show the retained radial\-inconsistency magnitude\. The substantially smaller radial values indicate that sheaf regularization suppresses radial inconsistency more strongly than would uniform velocity rescaling\.
## 6Conclusion
We proposed Sheaf SyncMap, which incorporates a radial sheaf structure to regularize pairwise forces and stabilize chunking dynamics\. Experimental results on independent CGCP graphs show that Sheaf SyncMap achieves higher NMI than other SyncMap variants, particularly for graphs with many small chunks\. Sequential adaptation experiments demonstrate that Sheaf SyncMap maintains high NMI while reducing frame\-to\-frame breathing, indicating that sheaf regularization stabilizes chunking dynamics without preventing adaptation to new graphs\. Future work will explore the application of Sheaf SyncMap to real\-world temporal data and investigate the theoretical properties of sheaf regularization in self\-organizing systems\.
## References
- \[1\]E\. Bonabeau, G\. Theraulaz, J\. Deneubourg, S\. Aron, and S\. Camazine\(1997\)Self\-organization in social insects\.Trends in ecology & evolution12\(5\),pp\. 188–193\.Cited by:[§1](https://arxiv.org/html/2609.25143#S1.p1.1)\.
- \[2\]E\. Karsenti\(2008\)Self\-organization in cell biology: a brief history\.Nature reviews Molecular cell biology9\(3\),pp\. 255–262\.Cited by:[§1](https://arxiv.org/html/2609.25143#S1.p1.1)\.
- \[3\]U\. Khadka, V\. Holubec, H\. Yang, and F\. Cichos\(2018\)Active particles bound by information flows\.Nature communications9\(1\),pp\. 3864\.Cited by:[§1](https://arxiv.org/html/2609.25143#S1.p1.1)\.
- \[4\]C\. R\. Reid, M\. J\. Lutz, S\. Powell, A\. B\. Kao, I\. D\. Couzin, and S\. Garnier\(2015\)Army ants dynamically adjust living bridges in response to a cost–benefit trade\-off\.Proceedings of the National Academy of Sciences112\(49\),pp\. 15113–15118\.Cited by:[§1](https://arxiv.org/html/2609.25143#S1.p1.1)\.
- \[5\]O\. Peleg, J\. M\. Peters, M\. K\. Salcedo, and L\. Mahadevan\(2018\)Collective mechanical adaptation of honeybee swarms\.Nature Physics14\(12\),pp\. 1193–1198\.Cited by:[§1](https://arxiv.org/html/2609.25143#S1.p1.1)\.
- \[6\]A\. Tero, S\. Takagi, T\. Saigusa, K\. Ito, D\. P\. Bebber, M\. D\. Fricker, K\. Yumiki, R\. Kobayashi, and T\. Nakagaki\(2010\)Rules for biologically inspired adaptive network design\.Science327\(5964\),pp\. 439–442\.Cited by:[§1](https://arxiv.org/html/2609.25143#S1.p1.1)\.
- \[7\]D\. V\. Vargas and T\. Asabuki\(2021\)Continual general chunking problem and syncmap\.InProceedings of the AAAI Conference on Artificial Intelligence,Vol\.35,pp\. 10006–10014\.Cited by:[§1](https://arxiv.org/html/2609.25143#S1.p2.1),[§2\.1](https://arxiv.org/html/2609.25143#S2.SS1.p1.4),[§2\.3](https://arxiv.org/html/2609.25143#S2.SS3.p1.1)\.
- \[8\]X\. Li and D\. V\. Vargas\(2025\)Individual vs\. group dynamics: impacts on equilibrium states in self\-organizing systems\.Neurocomputing648,pp\. 130575\.Cited by:[§1](https://arxiv.org/html/2609.25143#S1.p2.1),[§2\.1](https://arxiv.org/html/2609.25143#S2.SS1.p2.1),[§3\.1](https://arxiv.org/html/2609.25143#S3.SS1.p1.1),[§4](https://arxiv.org/html/2609.25143#S4.p1.1)\.
- \[9\]F\. Barbero, C\. Bodnar, H\. S\. de Ocáriz Borde, M\. Bronstein, P\. Veličković, and P\. Liò\(2022\)Sheaf neural networks with connection laplacians\.InTopological, Algebraic and Geometric Learning Workshops 2022,pp\. 28–36\.Cited by:[§1](https://arxiv.org/html/2609.25143#S1.p3.1)\.
- \[10\]C\. Bodnar, F\. Di Giovanni, B\. Chamberlain, P\. Lio, and M\. Bronstein\(2022\)Neural sheaf diffusion: a topological perspective on heterophily and oversmoothing in gnns\.Advances in Neural Information Processing Systems35,pp\. 18527–18541\.Cited by:[§1](https://arxiv.org/html/2609.25143#S1.p3.1)\.
- \[11\]J\. Seely, B\. Cupiał, and L\. Jones\(2026\)Learning multi\-agent coordination via sheaf\-admm\.arXiv preprint arXiv:2605\.31005\.Cited by:[§1](https://arxiv.org/html/2609.25143#S1.p3.1)\.
- \[12\]O\. Zariski\(1956\)Scientific report on the second summer institute, several complex variables\. part iii\. algebraic sheaf theory\.Bulletin of the American Mathematical Society62\(2\),pp\. 117–141\.Cited by:[§1](https://arxiv.org/html/2609.25143#S1.p3.1),[§2\.2](https://arxiv.org/html/2609.25143#S2.SS2.p1.1)\.
- \[13\]A\. D\. Shepard\(1985\)A cellular description of the derived category of a stratified space\.Brown University\.Cited by:[§1](https://arxiv.org/html/2609.25143#S1.p3.1),[§2\.2](https://arxiv.org/html/2609.25143#S2.SS2.p1.1)\.
- \[14\]H\. Zhang and D\. V\. Vargas\(2023\)Symmetrical syncmap for imbalanced general chunking problems\.Physica D: Nonlinear Phenomena456,pp\. 133923\.Cited by:[§2\.1](https://arxiv.org/html/2609.25143#S2.SS1.p1.4)\.
- \[15\]A\. Strehl and J\. Ghosh\(2002\)Cluster ensembles—a knowledge reuse framework for combining multiple partitions\.Journal of machine learning research3\(Dec\),pp\. 583–617\.Cited by:[§2\.4](https://arxiv.org/html/2609.25143#S2.SS4.p1.1)\.
- \[16\]E\. Schubert, J\. Sander, M\. Ester, H\. P\. Kriegel, and X\. Xu\(2017\)DBSCAN revisited, revisited: why and how you should \(still\) use dbscan\.ACM transactions on database systems \(tods\)42\(3\),pp\. 1–21\.Cited by:[§2\.4](https://arxiv.org/html/2609.25143#S2.SS4.p1.3)\.
## Appendix AAppendices
### A\.1Ablation Study
We conduct an ablation study to evaluate the contributions of the radial sheaf structure and directional history repulsion to the performance of Sheaf SyncMap\. We compare the following four configurations:
- •Sheaf SyncMap \(Decentralized SyncMap with both the radial sheaf structure and directional history repulsion\)
- •Decentralized SyncMap with the radial sheaf structure only
- •Decentralized SyncMap with directional history repulsion only
- •Decentralized SyncMap without either modification \(baseline\)
Figure 6:Ablation study of NMI scores in the adaptation experiments across five CGCP graphs\.Figure 7:Ablation study of the local chunking instability scoreBRMS\(t\)B\_\{\\mathrm\{RMS\}\}\(t\)in the adaptation experiments across five CGCP graphs\.The results of the ablation study are shown in[Figs\.6](https://arxiv.org/html/2609.25143#A1.F6)and[7](https://arxiv.org/html/2609.25143#A1.F7)\.[Figure6](https://arxiv.org/html/2609.25143#A1.F6)shows that when the number of chunks is significantly larger than the number of variables per chunk, as in the75×875\\times 8scenario, there is a clear performance gap among the four configurations\. Their NMI scores are ordered as follows: Sheaf SyncMap\>\>Decentralized SyncMap with directional history repulsion only\>\>Decentralized SyncMap with the radial sheaf structure only\>\>Decentralized SyncMap without either modification\. This result indicates that both the radial sheaf structure and directional history repulsion contribute to the performance of Sheaf SyncMap, with directional history repulsion making the larger contribution\.[Figure7](https://arxiv.org/html/2609.25143#A1.F7)further shows that the radial sheaf structure contributes more strongly to the stability of the chunking dynamics across all scenarios\.相似文章
无充分性验证:逐块过滤在多跳RAG中失效,分解方法可修复
本文表明,逐块验证在多跳RAG中会失败,因为没有任何单个块是充分的,并提出基于分解的验证方法来修复这一问题,在多个数据集上展示了显著改进。
扩散语言模型的动态分块
本文介绍了扩散语言模型的动态分块(DCDM),该方法使用可微分的Chunking Attention机制,用内容定义的语义块替换块离散扩散中的固定位置块,在高达1.5B参数规模上实现了一致的改进。
CompactAttention: 通过块合并KV选择加速分块预填充
CompactAttention引入块合并KV选择机制,加速长上下文LLM的分块预填充,在LLaMA-3.1-8B模型128K上下文下实现最高2.72倍注意力加速,同时保持与稠密注意力相近的精度。
基于层的联邦表示学习
本文介绍了基于层的联邦表示学习(SFRL),这是一个通过可学习的层限制映射和二次粘合正则化器来对齐异构局部表示的框架,无需假设共享的全局潜在空间。提出了一种具有收敛保证的分散式算法(Sheaf-FRL),并证明其在与数据异构和模型异构下的协作分类中优于基线方法。
说话人解耦的分块回归音节标记化
提出了一种说话人解耦的音节标记化方法,利用分块回归从原始语音中学习语言内容标记,在音节边界检测和聚类方面达到最先进水平,并提升了语音语言模型的性能。