用于事件驱动视觉-语言-动作推理的基于2的幂的泄漏积分发放神经元
摘要
该论文提出了二次幂泄漏积分发放(PoT-LIF)神经元,通过发出带符号、幅值为二次幂的脉冲,在无需重构预训练策略的情况下,使视觉-语言-动作模型能够进行事件驱动的脉冲计算。将其集成到 π0.5 VLA 的投影层后,该模型在 LIBERO 基准测试中的表现达到或超过了采用连续激活的基线,同时将建模估算的算术运算能耗降低了约 86.95%。
查看缓存全文
缓存时间: 2026/10/28 02:03
# Power-of-Two Leaky Integrate-and-Fire Neurons for Event-Driven Vision–Language–Action Inference
Source: [https://arxiv.org/html/2610.33658](https://arxiv.org/html/2610.33658)
## Power\-of\-Two Leaky Integrate\-and\-Fire Neurons for Event\-Driven Vision–Language–Action InferenceThanks:Corresponding author:nierongxiang@sivy\.ltd\.
He LvZiyao ZhangRui MaAffiliation:Rongxiang NieAffiliation:Sivy Limited, Hangzhou, ChinaAffiliation:www\.sivy\.ltd
###### Abstract
Vision–language–action \(VLA\) models have demonstrated strong capabilities in robotic manipulation, yet their reliance on dense, continuous\-valued computation presents a fundamental challenge for energy\-constrained deployment\. Inspired by the sparse, event\-driven signaling and temporal integration mechanisms of biological neurons, a promising alternative is to introduce spiking computation into VLA models\. However, enabling such computation without restructuring pretrained policies or compromising closed\-loop control remains an open challenge\. To address this challenge, we introduce the Power\-of\-Two Leaky Integrate\-and\-Fire \(PoT\-LIF\) neuron, which emits signed spikes with power\-of\-two amplitudes\. By combining magnitude\-coded spike events with residual\-preserving membrane dynamics, PoT\-LIF enables continuous information to be progressively represented through discrete spikes\. The Heartbeat formulation further localizes this process within weighted projections, bridging biologically inspired spiking computation and pretrained VLA architectures without modifying their external inference interfaces\. We integrate PoT\-LIF into the vision projection, vision–language projection, and action projection ofπ0\.5\\pi\_\{0\.5\}and evaluate both operating modes over 2,000 paired closed\-loop LIBERO episodes per configuration\. Standard\-mode PoT\-LIF VLA achieves success rates of 96\.90% and 96\.35% atT=1T=1andT=2T=2, respectively, while Heartbeat mode achieves 97\.25% and 96\.90% atT=2T=2andT=4T=4, compared with 96\.70% for the original continuous\-activationπ0\.5\\pi\_\{0\.5\}baseline\. AtT=1T=1with a 60\.01% firing rate, PoT\-LIF uses approximately1/7\.671/7\.67of the dense\-reference arithmetic energy, corresponding to a modeled reduction of 86\.95%\.
Keywords:spiking neural networks, vision\-language\-action, robot learning, neuromorphic computing
## 1Introduction
Vision–language–action \(VLA\) models couple pretrained vision–language backbones with action generation modules to enable closed\-loop robotic manipulation in open environments\[[1](https://arxiv.org/html/2610.33658#bib.bib1)\]\. Systems such asπ0\.5\\pi\_\{0\.5\}\[[2](https://arxiv.org/html/2610.33658#bib.bib2)\], Robotics Transformer 2 \(RT\-2\)\[[3](https://arxiv.org/html/2610.33658#bib.bib3)\], and OpenVLA\[[4](https://arxiv.org/html/2610.33658#bib.bib4)\]have demonstrated strong cross\-task generalization\. However, VLA inference repeatedly executes dense weighted projections across vision, language, and action modules, resulting in high energy consumption on edge platforms\. This motivates an alternative computational interface that preserves representational capacity while reducing arithmetic cost\.
Spiking neural networks \(SNNs\) offer an event\-driven computational paradigm\[[5](https://arxiv.org/html/2610.33658#bib.bib5)\]\. Leaky integrate\-and\-fire \(LIF\) neurons are widely adopted in SNNs\. They convert continuous membrane potentials into sparse binary spikes, allowing synaptic computation to occur only when spikes are emitted\.\[[6](https://arxiv.org/html/2610.33658#bib.bib6),[7](https://arxiv.org/html/2610.33658#bib.bib7)\]\. However, a single binary spike does not explicitly encode the magnitude of the underlying membrane potential\. To represent fine\-grained continuous values, binary SNNs often accumulate information over multiple time steps, increasing computation and scheduling overhead\. Recent studies, such as Spike\-driven VLA and DS\-VLA, have demonstrated the potential of SNNs for embodied control\[[8](https://arxiv.org/html/2610.33658#bib.bib8),[9](https://arxiv.org/html/2610.33658#bib.bib23)\]\. Their integration strategies include directly trained spiking architectures and dendritic spiking action modules\. However, these strategies can spread temporal processing across multiple modules, complicating integration into pretrained VLA architectures\. These limitations motivate two key design goals for integrating spiking computation into pretrained VLA models: \(1\) representing continuous values with a limited number of events, and \(2\) confining temporal processing to selected projections without altering token layout, residual connections, or key\-value \(KV\) cache organization\.
To address the representation requirement, we draw inspiration from biological observations of exponential computation and graded signaling\. Gabbiani et al\.\[[10](https://arxiv.org/html/2610.33658#bib.bib9)\]reported a nearly exponential mapping from membrane potential to firing rate in a locust visual neuron, consistent with multiplication through logarithmic input encoding and exponentiation by active membrane conductances\. In cortical circuits, presynaptic membrane potential can also modulate axonal action potentials and the synaptic responses they evoke\[[11](https://arxiv.org/html/2610.33658#bib.bib10)\]\. Motivated by these mechanisms, we use an exponent\-based event representation: the amplitude takes the formbe\{b\}^\{e\}whereb\>1b\>1andeeis an integer\. Successive exponent values specify multiplicative amplitude changes rather than equally spaced integer levels\. We chooseb=2b=2to align this representation with binary digital arithmetic\. Residual retention then allows successive events to refine the represented value under a bounded emission budget\.
We therefore propose a power\-of\-two leaky integrate\-and\-fire \(PoT\-LIF\) neuron\. A signed event has the formst=sgn\(ut\)2ets\_\{t\}=\\operatorname\{sgn\}\(u\_\{t\}\)2^\{e\_\{t\}\}, wheresgn\(ut\)∈\{−1,\+1\}\\operatorname\{sgn\}\(u\_\{t\}\)\\in\\\{\-1,\+1\\\}andete\_\{t\}is an integer\. For a floating\-point weightww, an event contribution is evaluated through scaling–accumulation \(SAC\), formally defined in Sec\.[3\.1](https://arxiv.org/html/2610.33658#S3.SS1)\. For normal values whose scaled results remain normal and representable, scaling adjusts the weight exponent and combines the signs without a general significand multiplication\. A residual membrane state retains the portion not represented by the current event, making the event budgetTTan explicit control over precision and computational work\.
The same PoT\-LIF recurrence supports two operating modes: standard mode and Heartbeat\. In standard mode, the neuron receives successive inputs and retains its membrane state across input calls\. Heartbeat instead applies the recurrence locally within each VLA projection: each projection invocation injects its input once and accumulates the weighted contributions of a bounded event sequence\. The residual is retained across internal extraction steps, and the local state is reset at the end of the invocation\. This confines the event\-time dimension to individual projections while preserving the original token count, residual connections, and KV caches\. Standard mode remains available for processing successive inputs and may support future integration with event\-based sensors\.
We evaluate PoT\-LIF in the vision projection, vision–language projection, and action projection ofπ0\.5\\pi\_\{0\.5\}using a fixed paired closed\-loop protocol on LIBERO\[[12](https://arxiv.org/html/2610.33658#bib.bib11)\]\. Across both the main and supplementary evaluations, all tested PoT\-LIF configurations ofπ0\.5\\pi\_\{0\.5\}differ from the denseπ0\.5\\pi\_\{0\.5\}baseline by no more than 0\.80 percentage points in success rate\. We also estimate the arithmetic energy of PoT\-LIF projection computation under a matched FP32 accumulation model, while excluding system\-level overheads\.
This paper makes three contributions:
- •A unified PoT\-LIF formulation with reconstruction guarantees\.We define a unified PoT\-LIF recurrence with signed power\-of\-two emissions and residual retention, describe its standard mode, and formulate Heartbeat as a specific input schedule\. We establish residual reconstruction guarantees under leak\-free dynamics and exact arithmetic, with the geometric error bound requiring inactive exponent clipping \(Sec\.[3](https://arxiv.org/html/2610.33658#S3)\)\.
- •PoT\-LIF integration intoπ0\.5\\pi\_\{0\.5\}with preserved closed\-loop performance\.We integrate PoT\-LIF into the vision projection, vision–language projection, and action projection ofπ0\.5\\pi\_\{0\.5\}and evaluate standard mode followed by Heartbeat mode\. Across both the main and supplementary evaluations, all tested PoT\-LIF configurations differ from the 96\.70% denseπ0\.5\\pi\_\{0\.5\}baseline by no more than 0\.80 percentage points in success rate \(Sec\.[5](https://arxiv.org/html/2610.33658#S5); paired statistical analyses are provided in Appendix[G](https://arxiv.org/html/2610.33658#A7)\)\.
- •Operation\-level energy model showing a 7\.67\-fold arithmetic\-energy advantage\.We formulate operation\-level energy accounting for multiply–accumulate \(MAC\) and scaling–accumulation \(SAC\), the computation adapted to PoT\-LIF and formally defined in Sec\.[3\.1](https://arxiv.org/html/2610.33658#S3.SS1)\. With matched FP32 accumulation and a 60\.01% firing rate atT=1T=1, the modeled PoT\-LIF arithmetic energy is approximately reach to 86\.95% reduction, excluding system\-level overheads\.
## 2Background and Related Work
In this section, we first review the biological and computational foundations of LIF neurons, including membrane dynamics and surrogate\-gradient training\. We then survey related work on event representations, efficient arithmetic, and spiking VLA models\.
### 2\.1Spiking neural networks and LIF dynamics
SNNs compute with discrete events rather than dense continuous\-valued activations\. A leaky integrate\-and\-fire \(LIF\) neuron integrates input into its membrane potential, exhibits passive leakage in the absence of input, emits a spike at threshold, and resets after emission \(\[[5](https://arxiv.org/html/2610.33658#bib.bib5)\],\[[6](https://arxiv.org/html/2610.33658#bib.bib6)\],\[[7](https://arxiv.org/html/2610.33658#bib.bib7)\]\)\. The LIF dynamics can be written as
τmdudt=−u\(t\)\+RmIsyn\(t\)\.\\tau\_\{m\}\\frac\{\\mathrm\{d\}u\}\{\\mathrm\{d\}t\}=\-u\(t\)\+R\_\{m\}I\_\{\\mathrm\{syn\}\}\(t\)\.\(1\)Whereu\(t\)u\(t\)is the membrane potential,τm\\tau\_\{m\}is the membrane time constant,RmR\_\{m\}is the membrane resistance, andIsyn\(t\)I\_\{\\mathrm\{syn\}\}\(t\)is the synaptic current\.
At discrete steptt, letθ\>0\\theta\>0be the firing threshold\. The binary spike occurs whenut\>θu\_\{t\}\>\\theta, we denote the spike by adapting the Heaviside function
z\(t\)=H\(ut−θ\)=\{1,ut≥θ,0,ut<θ\.z\(t\)=H\(u\_\{t\}\-\\theta\)=\\begin\{cases\}1,&u\_\{t\}\\geq\\theta,\\\\ 0,&u\_\{t\}<\\theta\.\\end\{cases\}\(2\)
Assume thatrtr\_\{t\}denotes the membrane state retained after emission and reset\. With zero resting potential, the hard and soft reset rules are given, respectively, by
rt=\(1−zt\)ut\(hard reset\),rt=ut−θzt\(soft reset\)\.r\_\{t\}=\(1\-z\_\{t\}\)u\_\{t\}\\quad\\text\{\(hard reset\)\},\\qquad r\_\{t\}=u\_\{t\}\-\\theta z\_\{t\}\\quad\\text\{\(soft reset\)\}\.\(3\)
An exponentially decaying synaptic currentIsyn\(t\)I\_\{\\mathrm\{syn\}\}\(t\)and the passive decay of the membrane potential in the absence of input are described by the following expressions, respectively\[[13](https://arxiv.org/html/2610.33658#bib.bib13),[14](https://arxiv.org/html/2610.33658#bib.bib14)\]:
Isyn\(t\)=Aexp\(−t/τs\),t≥0,u\(t\+Δt\)=exp\(−Δt/τm\)u\(t\),I\_\{\\mathrm\{syn\}\}\(t\)=A\\exp\(\-t/\\tau\_\{s\}\),\\quad t\\geq 0,\\qquad u\(t\+\\Delta t\)=\\exp\(\-\\Delta t/\\tau\_\{m\}\)u\(t\),\(4\)here,AAis the synaptic current amplitude andτs\\tau\_\{s\}andτm\\tau\_\{m\}are the synaptic and membrane time constants\. Discretizing this decay givesλ=exp\(−Δt/τm\)\\lambda=\\exp\(\-\\Delta t/\\tau\_\{m\}\), whereΔt\\Delta tis the discrete time step\.
A binary spike indicates whether a neuron fires; it does not explicitly encode the membrane\-potential magnitude\. Consequently, SNNs represent continuous quantities through rate coding, in which firing frequency carries the value, or temporal coding, in which spike timing carries the value\[[5](https://arxiv.org/html/2610.33658#bib.bib5),[15](https://arxiv.org/html/2610.33658#bib.bib15),[16](https://arxiv.org/html/2610.33658#bib.bib16)\]\. Such representations generally require multiple time steps\.
### 2\.2Surrogate\-gradient training
Binary spike generation is modeled by the Heaviside step function, whose derivative is zero almost everywhere and undefined at the threshold\. Consequently, direct backpropagation provides no useful gradients for learning\. Surrogate\-gradient methods enable gradient\-based training through discontinuous spike\-generation functions\[[17](https://arxiv.org/html/2610.33658#bib.bib17)\]\. The forward pass retains the binary spike, while the backward pass uses the derivative of a smooth substitute in place of the step\-function derivative\.
In this paper, PoT\-LIF changes the event amplitude and residual retention; its discontinuous event\-generation rule can still be trained using the same surrogate\-gradient principle\. Specifically, the forward pass retains the actual signed power\-of\-two events, while the backward pass approximates the derivatives of the discontinuous operations\. The training configuration used in this work is described in Sec\.[5](https://arxiv.org/html/2610.33658#S5)\.
### 2\.3Event representations and efficient arithmetic
Biological neurons exhibit a nearly exponential relationship between membrane potential and firing rate\. Presynaptic membrane potential also modulates axonal action potentials and postsynaptic response amplitudes\. These observations motivate introducing exponentially spaced firing levels and amplitude\-bearing events into LIF dynamics\. Theoretical analyses of neural coding under metabolic constraints\[[18](https://arxiv.org/html/2610.33658#bib.bib21)\]and experiments on energy\-efficient synaptic transmission\[[19](https://arxiv.org/html/2610.33658#bib.bib22)\]further motivate considering the information conveyed by each event alongside its computational cost\.
Logarithmic representations and DeepShift show how powers of two replace general multiplication with operations suited to binary hardware\[[20](https://arxiv.org/html/2610.33658#bib.bib18),[21](https://arxiv.org/html/2610.33658#bib.bib19)\]; AdderNet provides a complementary example of reducing reliance on multiplication through addition\-based distance operations\[[22](https://arxiv.org/html/2610.33658#bib.bib20)\]\. Combining this arithmetic motivation with the biological observations leads to PoT\-LIF: exponentially spaced levels followbeb^\{e\}, whereb\>1b\>1andeeis an integer, and choosingb=2b=2aligns the event amplitudes with binary digital arithmetic\. The resulting events carry a sign and an integer exponent, while the membrane retains the unrepresented residual\.
Neuromorphic hardware also supports carrying amplitude information in events\. Intel’s Loihi 2 supports graded spikes with integer\-valued payloads of up to 32 bits; its technology brief reports that the commonly used 8\-bit payload entails negligible extra energy cost relative to binary spike processing\[[23](https://arxiv.org/html/2610.33658#bib.bib30)\]\. This provides engineering evidence that amplitude\-bearing communication can preserve the energy advantages of sparse events, although the cost of a particular encoding depends on its implementation\. Together, biological exponential responses, power\-of\-two arithmetic, and hardware support for graded events motivate the PoT\-LIF representation\.
### 2\.4Spiking VLA models
Wang et al\.\[[8](https://arxiv.org/html/2610.33658#bib.bib8)\]introduce Spike\-driven VLA, which directly trains spiking perception, fusion, and action modules\. Its 0\.15B\-parameter model achieves only 92\.4% mean LIBERO success, leaving task success as a key limitation\.
Lyu et al\.\[[9](https://arxiv.org/html/2610.33658#bib.bib23)\]introduce DS\-VLA, which combines dendritic spiking dynamics with inhibitory gating for robust action control\. Although it improves resistance to action perturbations, its nominal LIBERO success rate remains only 91\.6%\.
We identify limited amplitude information in binary spikes as a key representational bottleneck, which limits success rates in spiking VLA control\. This motivates PoT\-LIF: signed power\-of\-two events convey magnitude information at low arithmetic cost, while residual retention refines the representation over successive events\. We aim to improve end\-to\-end task success without sacrificing the arithmetic efficiency of event\-based computation\.
In this section, we define the PoT\-LIF dynamics and SAC arithmetic\. We then introduce the Heartbeat operating mode\. Finally, we prove that under leak\-free dynamics, Heartbeat guarantees geometric error reduction, exact recovery at zero residual, and reconstruction error bounded by θ upon threshold stopping\.
### 3\.1PoT\-LIF event encoding and SAC
PoT\-LIF extends the discrete LIF recurrence in Sec\.[2\.1](https://arxiv.org/html/2610.33658#S2.SS1)by replacing the binary spike with a signed power\-of\-two event and retaining the residual\.
At each internal time steptt, the pre\-emission membrane potentialutu\_\{t\}is obtained from the input contributionItI\_\{t\}and the retained residualrt−1r\_\{t\-1\}:
ut=It\+λrt−1,u\_\{t\}=I\_\{t\}\+\\lambda r\_\{t\-1\},\(5\)whereλ\\lambdais the membrane decay factor defined in Sec\.[2\.1](https://arxiv.org/html/2610.33658#S2.SS1)\. In our implementation, the threshold is chosen on the event ladder:
θ=2h,h∈ℤ,emin≤h≤emax\.\\theta=2^\{h\},\\qquad h\\in\\mathbb\{Z\},\\qquad e\_\{\\min\}\\leq h\\leq e\_\{\\max\}\.\(6\)The full ladder containsemax−emin\+1=33e\_\{\\max\}\-e\_\{\\min\}\+1=33positive levels, or 66 signed nonzero levels\.
Each nonzero event in PoTLIF is encoded as
st=\{sgn\(ut\)2⌊log2\|ut\|⌋,\|ut\|≥θandut≠0,0,\|ut\|<θorut=0,s\_\{t\}=\\begin\{cases\}\\operatorname\{sgn\}\(u\_\{t\}\)2^\{\\lfloor\\log\_\{2\}\|u\_\{t\}\|\\rfloor\},&\|u\_\{t\}\|\\geq\\theta\\ \\text\{and\}\\ u\_\{t\}\\neq 0,\\\\ 0,&\|u\_\{t\}\|<\\theta\\ \\text\{or\}\\ u\_\{t\}=0,\\end\{cases\}\(7\)
On emitting steps, the ideal exponent is denoted byetideal=⌊log2\|ut\|⌋e\_\{t\}^\{\\mathrm\{ideal\}\}=\\lfloor\\log\_\{2\}\|u\_\{t\}\|\\rfloor\. In the finite\-range implementation, the emitted exponent is clipped to
et=\{emin,etideal<emin,etideal,emin≤etideal≤emax,emax,etideal\>emax,e\_\{t\}=\\begin\{cases\}e\_\{\\min\},&e\_\{t\}^\{\\mathrm\{ideal\}\}<e\_\{\\min\},\\\\ e\_\{t\}^\{\\mathrm\{ideal\}\},&e\_\{\\min\}\\leq e\_\{t\}^\{\\mathrm\{ideal\}\}\\leq e\_\{\\max\},\\\\ e\_\{\\max\},&e\_\{t\}^\{\\mathrm\{ideal\}\}\>e\_\{\\max\},\\end\{cases\}\(8\)in this way,et∈ℤe\_\{t\}\\in\\mathbb\{Z\}, and the exponent need not be evaluated whenst=0s\_\{t\}=0\. Thus, exponents within the prescribed window remain unchanged, while those outside it are saturated to the corresponding boundary\. The exponent is evaluated only when an event is emitted\. Each nonzero event therefore has a magnitude in the discrete set
\|st\|∈\{2e:e∈ℤ,emin≤e≤emax\}\.\|s\_\{t\}\|\\in\\left\\\{2^\{e\}:e\\in\\mathbb\{Z\},\\ e\_\{\\min\}\\leq e\\leq e\_\{\\max\}\\right\\\}\.\(9\)The exponent is carried in a signed 6\-bit field, restricted to\[−16,16\]\[\-16,16\], while the event sign is determined bysgn\(ut\)\\operatorname\{sgn\}\(u\_\{t\}\)and stored in a separate sign bit\. This window specifies the event format rather than the weight format\.
After emission, the remaining membrane potential is retained as
rt=ut−st\.r\_\{t\}=u\_\{t\}\-s\_\{t\}\.\(10\)Hence, in exact arithmetic,
st\+rt=ut=It\+λrt−1,s\_\{t\}\+r\_\{t\}=u\_\{t\}=I\_\{t\}\+\\lambda r\_\{t\-1\},\(11\)the residualrtr\_\{t\}is carried forward to the next internal time step\. In this way, the pre\-emission membrane potential is decomposed into the emitted event and the retained residual\. The settingλ=1\\lambda=1is the leak\-free special case used by our heartbeat configuration\.
Letaadenote an accumulator,wwa floating\-point weight, andsts\_\{t\}an event emitted by PoT\-LIF\. In exact arithmetic, given an eventsts\_\{t\}, the scaling–accumulation map \(SAC\) is defined as
SAC\(a,w,st\):=a\+wst=\{a\+sgn\(ut\)Scale2\(w,et\),st≠0,a,st=0,\\operatorname\{SAC\}\(a,w,s\_\{t\}\):=a\+ws\_\{t\}=\\begin\{cases\}a\+\\operatorname\{sgn\}\(u\_\{t\}\)\\operatorname\{Scale\}\_\{2\}\(w,e\_\{t\}\),&s\_\{t\}\\neq 0,\\\\ a,&s\_\{t\}=0,\\end\{cases\}\(12\)whereScale2\(w,et\):=2etw\\operatorname\{Scale\}\_\{2\}\(w,e\_\{t\}\):=2^\{e\_\{t\}\}w\. The corresponding accumulator update is
a←SAC\(a,w,st\)\.a\\leftarrow\\operatorname\{SAC\}\(a,w,s\_\{t\}\)\.\(13\)Thus, SAC accumulates weighted event contributions, while the event amplitudes are determined by the PoT\-LIF emission rule\.
For a receiving neuronjj, the accumulatoraja\_\{j\}is initialized to zero at each internal time steptt\. Applying SAC to the presynaptic eventsst,is\_\{t,i\}with connection weightswjiw\_\{ji\}produces the input contribution
It,j=aj=∑iSAC\(a,wji,st,i\)\.I\_\{t,j\}=a\_\{j\}=\\sum\_\{i\}\\operatorname\{SAC\}\(a,w\_\{ji\},s\_\{t,i\}\)\.\(14\)The accumulated input is not restricted to power\-of\-two values\. The receiving neuron then follows the same recurrence:
ut,j=It,j\+λrt−1,j,rt,j=ut,j−st,j\.u\_\{t,j\}=I\_\{t,j\}\+\\lambda r\_\{t\-1,j\},\\qquad r\_\{t,j\}=u\_\{t,j\}\-s\_\{t,j\}\.\(15\)
### 3\.2Heartbeat input schedule
Heartbeat is an input schedule that applies the same recurrence to a single input within a weighted projection\. At the start of each projection invocation, the local state is initialized tor0=0\{r\}\_\{0\}=0, and the input is injected once:
r0=0,It=\{x,t=1,0,t\>1\.r\_\{0\}=0,\\qquad I\_\{t\}=\\begin\{cases\}x,&t=1,\\\\ 0,&t\>1\.\\end\{cases\}\(16\)
The neuron then executes at mostTTevent\-extraction steps\. The resulting approximation is
qT\(x\)=∑t=1Tst,q\_\{T\}\(x\)=\\sum\_\{t=1\}^\{T\}s\_\{t\},\(17\)
At each tick, the pre\-emission membrane potential, event, and residual are computed using equations \([7](https://arxiv.org/html/2610.33658#S3.E7)\) and \([10](https://arxiv.org/html/2610.33658#S3.E10)\)\. A local accumulator, initialized to zero, is updated byq←q\+stq\\leftarrow q\+s\_\{t\}wheneverst≠0s\_\{t\}\\neq 0\. Execution stops when the residual becomes zero, when the emission gate produces no event, or when the tick budgetTTis exhausted\.
For a vector input, the recurrence is applied elementwise, With projection weight matrixWW, the event contributions are accumulated before the next nonlinearity:
WqT=∑t=1TWst\.Wq\_\{T\}=\\sum\_\{t=1\}^\{T\}Ws\_\{t\}\.\(18\)
The projection bias, if present, is added once\. The event\-time dimension therefore remains internal to the projection\. In our configuration, the decay rate is set toλ=1\\lambda=1, so a residual below the threshold cannot produce a later event in the absence of further input and extraction can stop immediately\.
Figure[1](https://arxiv.org/html/2610.33658#S3.F1)illustrates the two operating modes\. In Fig\.[1](https://arxiv.org/html/2610.33658#S3.F1)a, presynaptic events carrying signed power\-of\-two amplitudes arrive through weighted synapses\. The neuron integrates these contributions, emits events according to Eq\. \([7](https://arxiv.org/html/2610.33658#S3.E7)\), and retains the residual for subsequent inputs\. In Fig\.[1](https://arxiv.org/html/2610.33658#S3.F1)b, Heartbeat injects a scalar input once and extracts its event representation over at mostTTinternal steps\. Withλ=1\\lambda=1, the residual is retained without leakage between extraction steps and is reset at the end of the projection invocation\.
Figure 1:PoT\-LIF dynamics and power\-of\-two event encoding\. \(a\) Standard mode: presynaptic events arrive through weighted synapses and are integrated into the membrane state\. Each emitted event carries a sign and an integer exponent specifying its amplitude\. The residual remains in the membrane state across successive input calls\. \(b\) Heartbeat mode: a scalar input is injected once and decomposed into a bounded event sequence using the same recurrence withλ=1\\lambda=1\. The residual is retained between internal extraction steps, and the local state is reset at the end of the projection invocation\.
### 3\.3Reconstruction analysis
In the reconstruction analysis,rTr\_\{T\}denotes the residual before the local state is reset\. If extraction terminates at stepK<TK<Tunderλ=1\\lambda=1, we setst=0s\_\{t\}=0andrt=rKr\_\{t\}=r\_\{K\}for the remaining analytical stepst=K\+1,…,Tt=K\+1,\\ldots,T\.
###### Proposition 1\(Residual reconstruction forλ=1\\lambda=1\)\.
Letx∈ℝx\\in\\mathbb\{R\}, the initialization and input schedule is given in Eq\. \([16](https://arxiv.org/html/2610.33658#S3.E16)\)\. In exact arithmetic, assume thatλ=1\\lambda=1, the exponent window\[emin,emax\]\[e\_\{\\min\},e\_\{\\max\}\], and the thresholdθ=2h\\theta=2^\{h\}, whereh∈ℤh\\in\\mathbb\{Z\}andemin≤h≤emaxe\_\{\\min\}\\leq h\\leq e\_\{\\max\}, the unclipped emission rule in \([7](https://arxiv.org/html/2610.33658#S3.E7)\)\. LetK≤TK\\leq Tdenote the number of executed ticks, withrKr\_\{K\}evaluated before the state reset\. Then the inputxxcan be reconstructed:
x=qT\(x\)\+rK\.x=q\_\{T\}\(x\)\+r\_\{K\}\.\(19\)In particular:
\(i\) If an event is emitted at each of theTTsteps and the residual remains nonzero, then
\|x−qT\(x\)\|≤2−T\|x\|\.\|x\-q\_\{T\}\(x\)\|\\leq 2^\{\-T\}\|x\|\.\(20\)
\(ii\) If the residual reaches zero at some stept0≤T\{t\}\_\{0\}\\leq T, then
qT\(x\)=x\.q\_\{T\}\(x\)=x\.\(21\)
\(iii\) If extraction terminates since the remaining residual is below the threshold, then
\|x−qT\(x\)\|<θ\.\|x\-q\_\{T\}\(x\)\|<\\theta\.\(22\)
In case \(i\), the input range condition andθ≥2emin\\theta\\geq 2^\{e\_\{\\min\}\}prevents upper and lower exponent saturation on emitting ticks, respectively\. Each nonzero residual is therefore reduced by at least a factor of two\. Upper exponent saturation can invalidate this geometric contraction, but it does not invalidate Eq\. \([19](https://arxiv.org/html/2610.33658#S3.E19)\) or cases \(ii\) and \(iii\)\. The proof is given in Appendix[A](https://arxiv.org/html/2610.33658#A1)\.
Forλ<1\\lambda<1, any nonzero retained state is attenuated before subsequent emissions\. IfK≤TK\\leq Tticks are executed, summing the recurrence gives
x−qT\(x\)=rK\+\(1−λ\)∑t=1K−1rt\.x\-q\_\{T\}\(x\)=r\_\{K\}\+\(1\-\\lambda\)\\sum\_\{t=1\}^\{K\-1\}r\_\{t\}\.\(23\)The reconstruction error therefore includes both the terminal residual and accumulated leakage\. Consequently,qT\(x\)q\_\{T\}\(x\)generally does not reconstruct the full input, and the reconstruction bound above does not apply in this form\.
Our Heartbeat configuration fixesλ=1\\lambda=1and set the minimum supported event magnitude asθ=2emin=2−16\\theta=\{2\}^\{\{e\}\_\{\\operatorname\{min\}\}\}=\{2\}^\{\-16\}\. This threshold prevents emission when the residual is smaller than the encoding can represent\. If a lower threshold were activated, clipping the exponent toemin\{e\}\_\{\\operatorname\{min\}\}could produce an event larger than the residual and reverse its sign\.
When upper clipping is inactive, the decomposition successively extracts the nonzero power\-of\-two components of the input down to the minimum supported amplitude \(Sec\.[3\.1](https://arxiv.org/html/2610.33658#S3.SS1)\)\. Exact reconstruction is obtained when all nonzero components lie within the supported exponent range andTTis sufficient to extract them\. Otherwise, extraction either reaches the budget or stops with a residual smaller thanθ\\theta\. For example,x=1\.4375x=1\.4375produces the event sequence\(1,0\.25,0\.125,0\.0625\)\(1,\\,0\.25,\\,0\.125,\\,0\.0625\)\. Two events reconstruct1\.251\.25, whereas four reconstruct the input exactly\.
The worst\-case bound permits a relative error of up to 25% atT=2T=2\. For positive inputs, this limit is approached asxxapproaches2e\+1\{2\}^\{e\+1\}from below, provided clipping and the threshold do not interfere with extraction\. For example,x=1\.99x=1\.99leaves a residual of0\.490\.49, corresponding to a relative error of approximately 24\.6%\. The rule truncates rather than rounds: the residual contains the binary components below the second extracted nonzero bit\. It vanishes when the input has at most two nonzero binary components and both lie within the supported range\.
For the significands which distribut over\[1,2\)\[1,2\)uniformly, the mean relative error is approximately 9\.9% atT=2T=2, with a 95th percentile of 23\.1%\. AtT=4T=4, these values decrease to 1\.1% and 4\.0%, respectively\. These statistics describe the specified significand distribution rather than the activation distribution of the VLA model\.
## 4PoT\-LIF Integration into Pretrained Vision–Language–Action Models
We apply the recurrence defined in Sec\.[3](https://arxiv.org/html/2610.33658#S3)to the vision encoder, vision–language backbone, and flow\-matching action expert of pretrained VLA models\. In this work, we chooseπ0\.5\\pi\_\{0\.5\}\[[1](https://arxiv.org/html/2610.33658#bib.bib1),[2](https://arxiv.org/html/2610.33658#bib.bib2)\]as the foundation model\. We first evaluate standard mode, in which the event\-time dimension extends across layers within a bounded network\-level sequence, and then Heartbeat, which confines event generation and weighted accumulation to individual projections\. Each selected projection retains its original input and output shapes, preserving token organization, residual connections, KV\-cache structure, and the action\-generation interface\.
### 4\.1Projection\-level event dataflow
Figure[2](https://arxiv.org/html/2610.33658#S4.F2)shows the projection sites in the three principal components ofπ0\.5\\pi\_\{0\.5\}\. Figure[2](https://arxiv.org/html/2610.33658#S4.F2)\(a\) follows the visual inputs through the Sigmoid Loss for Language–Image Pre\-training \(SigLIP\) vision encoder\[[24](https://arxiv.org/html/2610.33658#bib.bib24)\]and PaliGemma vision–language model \(VLM\)\[[25](https://arxiv.org/html/2610.33658#bib.bib25)\]to the action expert\. Figure[2](https://arxiv.org/html/2610.33658#S4.F2)\(b\) illustrates how a PoT\-LIF encoder supplies events to each selected weighted projection\.
We incorporate PoT\-LIF into 26 specific projection sites across six functional classes: patch embedding, query/key/value \(Q/K/V\), attention output, gated feed\-forward layers, expert projections, and expert interfaces\.
The standard\-mode configurations useT=1T=1orT=2T=2internal time steps across the network for each image\-and\-prompt input\. Membrane states are reset when that input is supplied and retained between internal steps as events propagate across layers\. TheTToutput states are averaged at the velocity\-field readout\. State does not carry into the next image\-and\-prompt input\.
In Heartbeat mode, Q/K/V, attention\-output, and feed\-forward projections accumulate the weighted contributions of a bounded event sequence\. Attention\-score computation, softmax, normalization, and residual addition retain their original operations\. Event contributions are combined before the next nonlinearity, so the internal extraction steps do not expand the token sequence or replicate the KV cache\. The projection output has the same shape as in the continuous\-activation policy\.
For consistency with Sec\.[3](https://arxiv.org/html/2610.33658#S3), we write a projection using column\-vector notation,y=Wxy=Wx, with bias omitted\. Heartbeat produces the approximationy^=WqT\(x\)\\widehat\{y\}=W\{q\}\_\{T\}\(x\)by accumulating at mostTTevents per input element:
y^=∑t=1TWst,Wst=∑i:st,i≠0σt,iScale2\(W:,i,et,i\)\.\\widehat\{y\}=\\sum\_\{t=1\}^\{T\}Ws\_\{t\},\\qquad Ws\_\{t\}=\\sum\_\{i:s\_\{t,i\}\\neq 0\}\\sigma\_\{t,i\}\\operatorname\{Scale\}\_\{2\}\(W\_\{:,i\},e\_\{t,i\}\)\.\(24\)
Here,W:,i\{W\}\_\{:,i\}is the weight column associated with input elementii, andScale2\\operatorname\{Scale\}\_\{2\}applies power\-of\-two scaling to its floating\-point entries\. The inner sum includes only nonzero events\. For normal, representable results, scaling adjusts the weight exponent and combines the event and weight signs without a general significand multiplication\.
Under exact arithmetic, the projection error isy^−y=W\(qT\(x\)−x\)\\widehat\{y\}\-y=W\(\{q\}\_\{T\}\(x\)\-x\)\. Thus, the residual bounds in Sec\.[3](https://arxiv.org/html/2610.33658#S3)characterize the input reconstruction error; its effect on the projection also depends onWW\. Finite\-precision scaling and accumulation can introduce additional numerical error\. SAC requires event\-exponent decoding, exponent addition, and sign handling before accumulation\.
AtT=1T=1, standard mode and Heartbeat are equivalent under the evaluated design: each projection performs a single emission step per input element from a zero initial state, with no subsequent temporal update\. We report this shared configuration as standard mode atT=1T=1\. AtT=2T=2, standard mode retains a network\-wide temporal sequence, whereas Heartbeat performs both extraction steps locally within each projection\.
This scheduling distinction also affects weight movement\. On conventional hardware that reloads projection weights for each network pass, standard mode atT=2T=2requires two rounds of weight movement, in addition to repeated network execution and membrane\-state access\. Replacing multiplication with SAC therefore does not by itself establish an overall energy advantage for this implementation\. This limitation motivates Heartbeat: processing consecutive events within a single projection allows a suitable datapath to reuse resident weight tiles across extraction steps before advancing to the next layer\.
Figure 2:\(a\) PoT\-LIF integration intoπ0\.5\\pi\_\{0\.5\}\. Heartbeat encoders supply signed power\-of\-two events to selected weighted projections in the vision encoder, vision–language backbone, and action expert\. Event contributions are evaluated through scaling–accumulation \(SAC\) within each projection\. Attention computation, the blockwise mask, KV\-cache structure, residual paths, and action interfaces retain their original organization\. Dashed boxes indicate the three module groups; \(b\) shows the event–projection pairs within a block\. Abbreviations: RGB, red–green–blue; ViT, vision transformer; LM, language model; FFN, feed\-forward network; RMSNorm, root mean square normalization; adaRMSNorm, adaptive RMSNorm; GELU, Gaussian error linear unit; bbox, bounding box; proprio\., proprioceptive state; MatMul, matrix multiplication\.
## 5Robot Experiments
We initialize the PoT\-LIF policies from pretrainedπ0\.5\\pi\_\{0\.5\}and fine\-tune them for 5,000 optimizer updates with an effective batch size of 256\. The main configurations use the symmetric emission thresholdθ=2−16\\theta=2^\{\-16\}andλ=1\\lambda=1\. The forward pass uses signed power\-of\-two events, while the backward pass uses a straight\-through estimator \(STE\), which substitutes a prescribed gradient for the discontinuous event\-generation rule\[[17](https://arxiv.org/html/2610.33658#bib.bib17)\]\. The matched\-budget continuous control receives the same fine\-tuning budget\. Detailed training settings are provided in Appendix[E](https://arxiv.org/html/2610.33658#A5)\.
### 5\.1Protocol
We evaluate on the Spatial, Object, Goal, and LIBERO\-10 \(Long\-Horizon\) suites\[[12](https://arxiv.org/html/2610.33658#bib.bib11)\], with ten tasks and 500 closed\-loop episodes per suite, giving 2,000 episodes per configuration\. Conditions share initial states, paired inference noise, and the action interface \(evaluation seed 7\)\. Two RGB views, from the frontal base and left wrist cameras, are resized to224×224224\\times 224; a third wrist slot is inactive\. The policy predicts 10\-step action chunks and replans every five environment steps\. Actions between replanning points are executed open loop\. PoT\-LIF internal steps, flow\-solver steps, and environment steps are distinct time axes\.
### 5\.2Main results
Standard mode achieves 96\.90% overall success atT=1T=1and 96\.35% atT=2T=2, compared with 96\.70% for the continuous\-activation control\. Heartbeat achieves 97\.25% atT=2T=2and 96\.90% atT=4T=4\(Table[1](https://arxiv.org/html/2610.33658#S5.T1)\)\. Success rates remain essentially unchanged under the evaluated protocol; paired significance tests and detailed results are reported in Appendix[G](https://arxiv.org/html/2610.33658#A7)\.
Table 1:Main LIBERO results \(success rate per suite over 500 episodes; 2,000 per configuration\)\.Δ\\Deltais the overall percentage\-point difference from the continuous\-activation control\.ConfigurationSpatialObjectGoalLong\-H\.OverallΔ\\DeltaContinuous activation98\.898\.697\.092\.496\.70–Continuous, matched budget98\.097\.697\.891\.696\.25−\-0\.45Standard modeT=1T=199\.298\.497\.692\.496\.90\+\+0\.20Standard modeT=2T=298\.297\.897\.492\.096\.35−\-0\.35HeartbeatT=2T=299\.297\.498\.294\.297\.25\+\+0\.55HeartbeatT=4T=499\.298\.097\.892\.696\.90\+\+0\.20Performance varies across suites, with no single configuration achieving the highest success rate on all four\. The four event\-based configurations achieve 97\.4–98\.4% success on Object, compared with 98\.6% for the continuous\-activation control\. On Long\-Horizon, Heartbeat atT=2T=2achieves 94\.2%, compared with 92\.4% for the control\. Additional ablations of the architecture and training procedure are reported in Appendix[C](https://arxiv.org/html/2610.33658#A3)\.
### 5\.3Event statistics and the choice ofTT
Letnl\{n\}\_\{l\}be the number of input elements processed at projection sitell,al\{a\}\_\{l\}the number of nonzero events emitted there, anddl\{d\}\_\{l\}its output width\. The product\-weighted event ratio isμ=\(∑ldlal\)/\(∑ldlnl\)\\mu=\(\\sum\_\{l\}\{d\}\_\{l\}\{a\}\_\{l\}\)/\(\\sum\_\{l\}\{d\}\_\{l\}\{n\}\_\{l\}\)\. Weighting bydl\{d\}\_\{l\}counts the event–weight pairs across all outputs, including fused QKV projections\. For the sampled workload,μ2=1\.900\{\\mu\}\_\{2\}=1\.900andμ4=3\.480\{\\mu\}\_\{4\}=3\.480\. The projection\-activity accounting covers 26 instrumented sites under the eight\-observation sampling protocol described below\. Its dense reference count isN=∑ldlnl=2\.271×1012N=\\sum\_\{l\}d\_\{l\}n\_\{l\}=2\.271\\times\{10\}^\{12\}MACs, counting one weight–input product and its accumulation for each input–output connection\. This count covers the instrumented weighted projections, not all operations in a complete end\-to\-end policy inference\. Heartbeat withT=2T=2emits1\.240×1091\.240\\times\{10\}^\{9\}events, corresponding to4\.314×10124\.314\\times\{10\}^\{12\}event–weight pairs;T=4T=4emits2\.270×1092\.270\\times\{10\}^\{9\}events, corresponding to7\.902×10127\.902\\times\{10\}^\{12\}pairs\. Each nonzero event–weight pair contributes one SAC operation\.
We useT=2T=2as the default Heartbeat setting because it combines 97\.25% success with fewer event–weight operations thanT=4T=4\. The latter requires approximately 1\.83 times as many SAC operations, while scoring 96\.90%\. Operation counts use eight fixed observations \(one environment observation and seven demonstration frames\) over the 26 projection sites\.
## 6Operation\-Level Energy Accounting
A reference product is one dense weight–input product; its event\-coded replacement may require multiple event–weight products\. We compare the arithmetic energy of dense FP32 MAC computation with PoT\-LIF SAC computation using matched FP32 accumulation\. The comparison uses an illustrative 45\-nm arithmetic model and includes only multiplication or exponent scaling and accumulation\. Data movement, memory access, control logic, event encoding, and other system\-level costs are excluded\.
The dense reference uses 4\.6 pJ per FP32 MAC\[[16](https://arxiv.org/html/2610.33658#bib.bib16),[26](https://arxiv.org/html/2610.33658#bib.bib27)\]\. For SAC, we use 0\.9 pJ for FP32 addition and a 0\.1 pJ integer\-addition proxy for exponent addition, giving an illustrative arithmetic cost of 1\.0 pJ per event–weight pair\. The exponent\-addition term uses a 32\-bit integer\-addition reference as a proxy\. The floating\-point addition cost represents the accumulation arithmetic, including its associated alignment, normalization, and rounding\.
The 2\.271 trillion reference MACs come from the 26\-site projection\-activity accounting in Sec\.[5\.3](https://arxiv.org/html/2610.33658#S5.SS3), based on eight fixed observations \(one environment observation and seven demonstration frames\)\. They count the covered weight–input products, excluding attention\-score products, softmax, normalization, and other operations outside those projections\. Multiplying this projection workload by 4\.6 pJ per MAC gives an estimated dense arithmetic energy of 10\.45 J\. For the newT=1T=1setting, using the reported 60\.01% firing rate as the effective event–weight activity fraction givesμ1=0\.6001\\mu\_\{1\}=0\.6001\. Applied to the same reference workload, this implies approximately 1\.363 trillion SAC operations and 1\.36 J, corresponding to an 86\.95% reduction\. The sampledT=2T=2count of 4\.314 trillion SAC operations gives 4\.31 J, corresponding to a 58\.7% reduction\. ForT=4T=4, 7\.902 trillion SAC operations give 7\.90 J, corresponding to a 24\.4% reduction\.
The arithmetic\-energy advantage depends on both the SAC unit cost and the number of events\. Withμ1=0\.6001\\mu\_\{1\}=0\.6001atT=1T=1and an assumed SAC arithmetic cost of 1\.0 pJ, the reference\-to\-SAC energy ratio is4\.6/\(0\.6001×1\.0\)≈7\.674\.6/\(0\.6001\\times 1\.0\)\\approx 7\.67, corresponding to an 86\.95% energy saving\. Increasing the assumed SAC cost to 1\.1 or 1\.2 pJ gives 0\.66011 or 0\.72012 pJ per reference product, reducing the estimated energy saving to 85\.65% or 84\.35%, respectively\.
Forffreference products per second, modeled arithmetic power is4\.6f4\.6fpW for FP32 MAC and0\.6001f0\.6001fpW for PoT\-LIF \(T=1T=1, firing rate 60\.01%\)\.
Figure 3:Average arithmetic energy per reference product with matched FP32 accumulation\. One FP32 MAC costs 4\.6 pJ\. AtT=1T=1and a 60\.01% firing rate, the PoT\-LIF SAC path averages 0\.6001 pJ: 0\.06001 pJ for exponent scaling and 0\.54009 pJ for accumulation\. The reference\-to\-SAC energy ratio is 7\.67, corresponding to a modeled reduction of 86\.95%\. Other power terms are excluded\.We estimate the energy of PoT\-LIF relative to a dense FP8 E4M3 baseline using matched FP8 weights and FP32 accumulation, with a 45 nm reference cost model augmented by engineering proxies for exponent and control operations\. ForT=1T=1andT=2T=2ticks with exponent\-window half\-widthk=4k=4, sampled fanout\-weighted activity yields0\.60010\.6001and1\.05651\.0565SAC contributions per original dense projection product, respectively\. The modeled projection\-arithmetic cost consequently decreases from1\.46461\.4646pJ to0\.59260\.5926pJ and1\.04321\.0432pJ, corresponding to reductions of59\.54%59\.54\\%and28\.77%28\.77\\%\. Including neuron encoding and the other modeled computation gives compute\-only savings of56\.25%56\.25\\%and27\.16%27\.16\\%\. Under an identical fixed data\-movement budget of2\.5182\.518J per policy inference \(ten denoising steps\), the modeled dynamic\-energy subtotal decreases from6\.0386\.038J to4\.0584\.058J and5\.0825\.082J, yielding savings of32\.79%32\.79\\%and15\.83%15\.83\\%\.
Figure 4:Modeled projection arithmetic energy relative to an FP8 E4M3 baseline\.Both methods use FP8 weights and FP32 accumulation\. Energy is normalized per original dense projection product using sampled fanout\-weighted activity:0\.60010\.6001and1\.05651\.0565SAC contributions forT=1T=1andT=2T=2, respectively, withk=4k=4\. Green denotes multiplication or exponent scaling and control; gray denotes FP32 accumulation\. PoT\-LIF reduces modeled projection arithmetic energy by59\.54%59\.54\\%and28\.77%28\.77\\%\. These estimates conditionally transfer BF16\-derived activity to FP8 weights and exclude neuron encoding, shared computation, and data movement\.Figure 5:Modeled dynamic energy per policy inference with a matched fixed data\-movement budget\.Each inference includes ten denoising steps; all configurations use FP8 weights and FP32 accumulation\. Green denotes projection arithmetic, gold denotes neuron encoding and other modeled computation, and light gray denotes the identical2\.5182\.518J data\-movement budget\. Withk=4k=4, the modeled subtotal decreases from6\.0386\.038J to4\.0584\.058J forT=1T=1and5\.0825\.082J forT=2T=2, corresponding to savings of32\.79%32\.79\\%and15\.83%15\.83\\%\. Results are conditional on BF16\-derived activity and represent partial energy estimates, not hardware measurements or complete system energy\.
## 7Discussion
As demonstrated, PoT\-LIF combines exponent\-based event amplitudes with residual membrane dynamics\. Standard mode and Heartbeat use the same recurrence but organize its execution differently: standard mode retains temporal processing across layers, while Heartbeat confines event generation and accumulation to individual projections\. This local schedule preserves the pretrained policy’s external token and cache organization and allows the event budget to be set within each projection\.
The two schedules offer different paths toward deployment\. For the current frame\-based VLA workload, the repeated weight movement of standard mode atT=2T=2adds to its energy cost on conventional hardware\. Reducing data\-movement costs would allow a larger share of the arithmetic savings from power\-of\-two event coding to translate into end\-to\-end energy savings\. Near\-memory and compute\-in\-memory implementations that support resident weights, local membrane state, and efficient event accumulation offer a route to reducing the repeated weight\-access cost of standard mode\. Future work will co\-design standard\-mode event scheduling, membrane\-state placement, and weight reuse for these architectures\. Standard mode also retains the potential to process asynchronous event data because membrane state evolves with successive inputs\.
The reconstruction guarantees in Sec\.[3\.3](https://arxiv.org/html/2610.33658#S3.SS3)characterize the fidelity of the event representation, whereas closed\-loop success also depends on how projection errors propagate through the policy and affect action generation\. A larger event budget can therefore improve scalar reconstruction under the stated conditions but need not yield higher task success\. In our experiments, increasing the Heartbeat budget fromT=2T=2toT=4T=4increases the number of event–weight operations without improving the observed success rate\. This supports selecting the event budget jointly from task performance and computational work, rather than from reconstruction accuracy alone\.
Finally, regarding arithmetic efficiency, under the per\-product accounting used here, theT=1T=1SAC path at a 60\.01% firing rate averages 0\.6001 pJ per reference product\. Its modeled arithmetic energy is approximately reach to an 86\.95% reduction\.
## 8Conclusion
This work introduces PoT\-LIF and successfully integrated its signed power\-of\-two events and residual\-preserving dynamics into pretrainedπ0\.5\\pi\_\{0\.5\}\. The proposed Heartbeat mode achieves 97\.25% LIBERO success compared with 96\.70% for the original policy, preserving task performance while replacing dense projection multiplication with event\-based scaling and accumulation\. Under the matched operation\-level energy model, theT=1T=1path at a 60\.01% firing rate uses approximately1/7\.671/7\.67of the dense\-reference arithmetic energy, corresponding to an 86\.95% reduction\.
PoT\-LIF is broadly applicable beyondπ0\.5\\pi\_\{0\.5\}to VLA models with compatible weighted\-projection architectures\. By localizing event processing within projections, Heartbeat preserves token layout, residual connections, KV\-cache organization, and the action interface\. This offers a route to easing the energy demands of edge VLA deployment while maintaining task success, as demonstrated here onπ0\.5\\pi\_\{0\.5\}\. In conclusion, PoT\-LIF enables energy\-efficient VLA inference by preserving closed\-loop task performance while reducing arithmetic costs, paving the way for more efficient and sustainable embodied AI\.
## Acknowledgments
We thank the open\-source robot\-learning and neuromorphic\-computing communities for the software, benchmarks, and published research that enabled this study\.
## Appendix
## Appendix AProof of Proposition[1](https://arxiv.org/html/2610.33658#Thmproposition1)
###### Proof\.
Under the assumptions of Proposition[1](https://arxiv.org/html/2610.33658#Thmproposition1),r0=0r\_\{0\}=0,I1=xI\_\{1\}=x,λ=1\\lambda=1, andIt=0I\_\{t\}=0fort\>1t\>1\. Thusu1=xu\_\{1\}=x, whileut=rt−1u\_\{t\}=r\_\{t\-1\}fort\>1t\>1\. Summingrt=It\+rt−1−str\_\{t\}=I\_\{t\}\+r\_\{t\-1\}\-s\_\{t\}gives
rT=x−qT\(x\)\.r\_\{T\}=x\-q\_\{T\}\(x\)\.When an event fires under the unclipped rule,
\|st\|=2⌊log2\|ut\|⌋,\|st\|≤\|ut\|<2\|st\|\.\|s\_\{t\}\|=2^\{\\lfloor\\log\_\{2\}\|u\_\{t\}\|\\rfloor\},\\qquad\|s\_\{t\}\|\\leq\|u\_\{t\}\|<2\|s\_\{t\}\|\.Because the event has the same sign as the potential,
\|rt\|=\|ut\|−\|st\|<12\|ut\|\.\|r\_\{t\}\|=\|u\_\{t\}\|\-\|s\_\{t\}\|<\\tfrac\{1\}\{2\}\|u\_\{t\}\|\.\(i\) If allTTsteps emit and the residual remains nonzero, repeated application gives\|x−qT\(x\)\|=\|rT\|≤2−T\|x\|\|x\-q\_\{T\}\(x\)\|=\|r\_\{T\}\|\\leq 2^\{\-T\}\|x\|\. \(ii\) Ifrt0=0r\_\{t\_\{0\}\}=0for somet0≤Tt\_\{0\}\\leq T, all subsequent events are zero andqT\(x\)=xq\_\{T\}\(x\)=x\. \(iii\) If extraction stops because\|ut\|<θ\|u\_\{t\}\|<\\theta, the residual is held fixed for the remaining analytical steps, so\|x−qT\(x\)\|=\|rT\|<θ\|x\-q\_\{T\}\(x\)\|=\|r\_\{T\}\|<\\theta\. Forλ<1\\lambda<1, summing over theKKexecuted ticks gives Eq\. \([23](https://arxiv.org/html/2610.33658#S3.E23)\); the accumulated leakage prevents the same residual\-only reconstruction bound\. The halving argument requires inactive exponent clipping, as specified in Sec\.[3\.3](https://arxiv.org/html/2610.33658#S3.SS3)\. ∎
## Appendix BConfigurable Response: Definition and Fits
Let\{θk\}\\\{\{\\theta\}\_\{k\}\\\}be ordered thresholds andck\{c\}\_\{k\}the increment associated with thresholdkk, represented by a bounded sum of signed power\-of\-two terms\. The output response is
fΘ,𝒞\(x\)=c0\+∑kck𝟏\[x≥θk\],ck=∑j=1Bkbkj2ekj\.f\_\{\\Theta,\\mathcal\{C\}\}\(x\)=c\_\{0\}\+\\sum\_\{k\}c\_\{k\}\\mathbf\{1\}\[x\\geq\\theta\_\{k\}\],\\qquad c\_\{k\}=\\sum\_\{j=1\}^\{B\_\{k\}\}b\_\{kj\}2^\{e\_\{kj\}\}\.\(25\)
Here,c0\{c\}\_\{0\}is the response forx<θ1x<\{\\theta\}\_\{1\},bkj∈\{−1,\+1\}\{b\}\_\{kj\}\\in\\\{\-1,\+1\\\},ekj\{e\}\_\{kj\}is an integer exponent, andBk\{B\}\_\{k\}is the local pulse budget\. Threshold positions set the segment boundaries, and the pulse codes separately set the increments;ckc\_\{k\}is not constrained to equalθk\\theta\_\{k\}\. These parameters can be fixed to construct a response or optimized using a straight\-through estimator \(STE\), which replaces a discontinuous forward derivative with a prescribed backward value,\[[17](https://arxiv.org/html/2610.33658#bib.bib17)\]\. The VLA experiments use the greedy extraction rule of Sec\.[3\.1](https://arxiv.org/html/2610.33658#S3.SS1)and retain the original network nonlinearities; they do not use this threshold table\. The budgetBk\{B\}\_\{k\}per threshold increment is distinct from the event budgetTTper projection input\. Figure[6](https://arxiv.org/html/2610.33658#A8.F6)in Sec\.reports fits to three reference nonlinearities using this construction\.
## Appendix CSupplementary Surrogate and Training Comparisons
Table 2:STE training ablation over 2,000 paired LIBERO episodes per configuration\. Both runs start from the same pretrained checkpoint and are fine\-tuned separately with the indicated surrogate\.ConfigurationSurrogate settingSuccess \(%\)HeartbeatT=4T=4, identity STEidentity surrogate96\.90HeartbeatT=4T=4, magnitude STEmagnitude surrogate96\.90The identity\-STE and magnitude\-STE Heartbeat models atT=4T=4are fine\-tuned separately from the same initialπ0\.5\\pi\_\{0\.5\}checkpoint, yielding a distinct final checkpoint for each surrogate\. Both achieve 96\.90% success under the paired evaluation protocol\. The matched\-budget continuous control \(96\.25%\) continues fine\-tuningπ0\.5\\pi\_\{0\.5\}with continuous activations for the same number of updates as the event\-based variants, providing a reference that accounts for the additional training budget\. Standard mode atT=2T=2achieves 96\.35% \(Table[1](https://arxiv.org/html/2610.33658#S5.T1)\)\. Relative to Heartbeat, it changes both temporal execution across layers and the velocity\-field readout, so this comparison assesses their combined effect\.
## Appendix DEvent\-Representation Comparison
Table[3](https://arxiv.org/html/2610.33658#A4.T3)compares our result with the reported nominal LIBERO success rates of other spiking VLA models\.
Table 3:Reported nominal LIBERO success of spiking VLA models\. Results use each study’s architecture and training protocol; — indicates an unlisted parameter count\. The PoT\-LIF row repeats the HeartbeatT=2T=2result in Table[1](https://arxiv.org/html/2610.33658#S5.T1)\.MethodParametersImplementationLIBERO meanSpike\-driven VLA\[[8](https://arxiv.org/html/2610.33658#bib.bib8)\]0\.15Bfully spiking, direct training92\.4%DS\-VLA\[[9](https://arxiv.org/html/2610.33658#bib.bib23)\]—dendritic spiking action control91\.6%PoT\-LIF onπ0\.5\\pi\_\{0\.5\}3\.3BHeartbeatT=2T=2projections97\.25%PoT\-LIF achieves the highest reported nominal success among the models in Table[3](https://arxiv.org/html/2610.33658#A4.T3): 97\.25%, exceeding Spike\-driven VLA by 4\.85 percentage points and DS\-VLA by 5\.65 points\. These results highlight the task\-success advantage of combining amplitude\-bearing events with a strong pretrained VLA\.
Table[4](https://arxiv.org/html/2610.33658#A4.T4)compares the event representations and integration strategies of the spiking VLA systems discussed in Sec\.[2](https://arxiv.org/html/2610.33658#S2)\. The two PoT\-LIF modes share signed power\-of\-two events and residual membrane updates\. Standard mode propagates events across layers, whereas Heartbeat accumulates their weighted contributions within each projection\. The distinction concerns the execution schedule of the recurrence, as described in Secs\.[3](https://arxiv.org/html/2610.33658#S3)–[4](https://arxiv.org/html/2610.33658#S4)\.
Table 4:Event representations and integration strategies\. Entries summarize the cited models; the PoT\-LIF rows refer to theπ0\.5\\pi\_\{0\.5\}implementation evaluated here\.ModelEvent representationIntegration strategySpike\-driven VLA\[[8](https://arxiv.org/html/2610.33658#bib.bib8)\]Binary spikesSpiking perception, fusion, and action modulesDS\-VLA\[[9](https://arxiv.org/html/2610.33658#bib.bib23)\]Spiking dynamicsDendritic\-inspired architecture for action controlPoT\-LIF standard modeSigned power\-of\-two events; residual retentionTemporal sequence across layersPoT\-LIF HeartbeatSigned power\-of\-two events; residual retentionEvent generation and accumulation within each projection
## Appendix ERun\-Mode Parameters and Numerical Formats
The main configurations use bfloat16 \(BF16\) weights; the main Heartbeat configurations use FP32 membrane state\. The supplementary FP8/A24 configuration uses FP8 E4M3FN weights\[[27](https://arxiv.org/html/2610.33658#bib.bib28)\], decoded through a BF16 container, and a 24\-bit signed block\-floating\-point persistent accumulator\. E4M3FN denotes a finite\-value FP8 format with four exponent bits and three fraction bits\.
Table 5:Operating\-mode parameters\. Both modes use the integration and residual balance in Eq\. \([10](https://arxiv.org/html/2610.33658#S3.E10)\) and the emission rule in Eq\. \([7](https://arxiv.org/html/2610.33658#S3.E7)\); the evaluated policies use ten external flow\-matching solver steps, distinct from the internal event budget\.ParameterStandard modeHeartbeatInput flowone current per ticksingle injectionI1=x\{I\}\_\{1\}=xDecayλ\\lambdaconfigurable \(main runs: 1\)1Emission thresholdθ\\thetaTwo\-sided; main runs:2−16\{2\}^\{\-16\}two\-sided, code floor2emin=2−16\{2\}^\{\{e\}\_\{\\operatorname\{min\}\}\}=\{2\}^\{\-16\}State initializationr0=0\{r\}\_\{0\}=0for each image\-and\-prompt inputr0=0\{r\}\_\{0\}=0per projection invocation;u1=x\{u\}\_\{1\}=xResidual update and resetSubtractive update each internal step; reset at next image\-and\-prompt inputSubtractive update; reset afterTTsteps or early terminationEvent applicationevents propagate downstreamapplied inside the projectionCross\-layer time axispresentnoneTable 6:Training parameters and numerical formats\. FP8 weights and A24 accumulation are supplementary configurations; the main table uses BF16 weights\.ParameterSettingDecayλ\\lambda1 \(no leakage during local decomposition\)Emission thresholdθ\\thetatwo\-sided code floor2emin=2−16\{2\}^\{\{e\}\_\{\\operatorname\{min\}\}\}=\{2\}^\{\-16\}; extracts nonzero powers of the input significandPrimary Heartbeat andT=1T=1surrogatemagnitude STE on the reconstructed sum,gT\(x\)=qT\(x\)/x\{g\}\_\{T\}\(x\)=\{q\}\_\{T\}\(x\)/xforx≠0x\\neq 0Surrogate atx=0x=0magnitude:00at full strength,1−α1\-\\alphaduring insertion; identity:11Standard\-mode surrogate atT=2T=2constant 0\.5 including at zero membrane potential, with cross\-tick backpropagationFP8 weightsE4M3FN, static power\-of\-two per\-tensor scaleA24 accumulator24\-bit signed block\-floating\-point persistent stateOptimizerAdam with decoupled weight decay \(AdamW\)\[[28](https://arxiv.org/html/2610.33658#bib.bib29)\],β1=0\.9\{\\beta\}\_\{1\}=0\.9,β2=0\.95\{\\beta\}\_\{2\}=0\.95,ϵ=10−8\\epsilon=\{10\}^\{\-8\}, weight decay10−10\{10\}^\{\-10\}, grad\-norm clip 1\.0Learning\-rate schedulelinear warmup 200 updates to5×10−65\\times\{10\}^\{\-6\}, cosine decay to10−6\{10\}^\{\-6\}; exponential moving average \(EMA\) decay 0\.999PoT insertionlinear ramp over the first 1,000 optimizer updates \(α:0→1\\alpha:0\\to 1\)Membrane precisionFP32 in Heartbeat main runs \(BF16 membrane: separate no\-fine\-tuning variant\)Seedstraining 42, evaluation 7Fine\-tuning5,000 optimizer updates, effective batch 256 across 4 devicesForward executionSAC per nonzero event–weight pair; floating\-point power\-of\-two scaling through exponent addition and sign handling, followed by accumulation inside the projectionDuring gradual insertion, Heartbeat uses the forward mapx\+α\(qT\(x\)−x\)x\+\\alpha\(\{q\}\_\{T\}\(x\)\-x\), whereα=clip\(s/\(1000a\),0,1\)\\alpha=clip\(s/\(1000a\),0,1\),ssis the microstep index, andaais the gradient\-accumulation depth\. The effective surrogate derivative is\(1−α\)\+αgT\(x\)\(1\-\\alpha\)\+\\alpha\{g\}\_\{T\}\(x\); at zero input it is1−α1\-\\alphafor the magnitude surrogate\. The sharedT=1T=1configuration uses the magnitude STE \(Appendix[H](https://arxiv.org/html/2610.33658#A8)\)\. Standard mode atT=2T=2differentiates through its membrane recurrence with a local gain of 0\.5\. For the local recurrence withλ=1\\lambda=1, this gives∂st/∂Ik=0\.5⋅0\.5t−k\\partial\{s\}\_\{t\}/\\partial\{I\}\_\{k\}=0\.5\\cdot\{0\.5\}^\{t\-k\}fork≤tk\\leq t, with internal inputs treated as independent\. Membrane states persist across the network’s internal steps and reset for each new image\-and\-prompt input\. For a nonzero weight tensorWW, FP8 quantization uses a static power\-of\-two scale with exponente=⌈log2\(max\|W\|/448\)⌉e=\\lceil\{\\operatorname\{log\}\}\_\{2\}\(\\operatorname\{max\}\|W\|/448\)\\rceiland round\-to\-nearest\-even conversion\. Biases, normalization scales, and embeddings retain their original precision\. Query–key score products and attention\-weighted value products remain floating\-point\.
## Appendix FT=1T=1SAC Arithmetic Accounting
This appendix reports only the operation\-level arithmetic energy for one dense reference product\. It excludes data transport, static random\-access memory \(SRAM\) and register access, event decoding, sign\-control logic, membrane encoding, leakage, clocking, communication, and other system\-level costs\.
The comparison uses one conventional FP32 multiply–accumulate \(MAC\) as the reference\. The 4\.6 pJ MAC cost is decomposed into a 3\.7 pJ FP32 multiplication and a 0\.9 pJ FP32 accumulation\.
For the PoT\-LIFT=1T=1path, each input produces at most one signed power\-of\-two event\. Using the reported 60\.01% firing rate as the effective event–weight activity fraction gives an average of 0\.6001 SAC operations per reference product, with zero\-event contributions skipped\. Each event requires one exponent\-scaling operation and one FP32 accumulation\. Exponent scaling is assigned an illustrative cost of 0\.1 pJ per operation, using an integer\-addition cost as a proxy\.
Table 7:Average arithmetic energy per dense reference product with matched FP32 accumulation; theT=1T=1PoT\-LIF row uses a 60\.01% firing rate\. All other power terms are excluded\.PathMultiplication / scaling \(pJ\)FP32 accumulation \(pJ\)Total \(pJ\)FP32 MAC1×3\.7=3\.71\\times 3\.7=3\.71×0\.9=0\.91\\times 0\.9=0\.94\.6PoT\-LIFT=1T=10\.6001×0\.10\.6001\\times 0\.1=0\.06001=0\.060010\.6001×0\.90\.6001\\times 0\.9=0\.54009=0\.540090\.6001Thus, under this matched arithmetic model, PoT\-LIFT=1T=1averages 0\.6001 pJ per reference product and the FP32 MAC reference uses 4\.6 pJ\. The energy ratio is4\.6/0\.6001≈7\.674\.6/0\.6001\\approx 7\.67, and the arithmetic\-energy reduction is1−0\.6001/4\.6≈86\.95%1\-0\.6001/4\.6\\approx 86\.95\\%\.
These values are arithmetic\-energy estimates rather than hardware measurements\. At an operation rate offfreference products per second, the corresponding modeled arithmetic powers are4\.6f4\.6fpW for the FP32 MAC path and0\.6001f0\.6001fpW for the PoT\-LIFT=1T=1path\. Full\-system power is outside the scope of this accounting\.
## Appendix GMcNemar Pairing Statistics
All 25 comparisons use 2,000 paired episodes\. For models A and B,bbcounts A\-success/B\-failure pairs andcccounts A\-failure/B\-success pairs\. The exact two\-sided McNemar value\[[29](https://arxiv.org/html/2610.33658#bib.bib26)\]isp=min\(1,2∑k=0min\(b,c\)\(b\+ck\)2−\(b\+c\)\)p=\\operatorname\{min\}\(1,2\\sum\_\{k=0\}^\{\\operatorname\{min\}\(b,c\)\}\\binom\{b\+c\}\{k\}\{2\}^\{\-\(b\+c\)\}\)\. Table[8](https://arxiv.org/html/2610.33658#A8.T8)groups the comparisons as follows: F1 contains the six dense\-control rows, F2 the three matched\-budget continuation rows, and E the 16 exploratory rows\. Holm correction\[[30](https://arxiv.org/html/2610.33658#bib.bib12)\]is applied separately within F1 and F2\. F1 includes the four main event configurations and two supplementary configurations: Heartbeat trained with the identity STE and the FP8/A24 variant\. The two STE configurations are fine\-tuned separately from the same initial checkpoint and evaluated using their respective final checkpoints\. F2 compares standard mode atT=1T=1and Heartbeat atT=2T=2andT=4T=4against the matched\-budget continuous control to account for the additional fine\-tuning updates\. Archived FP8/FP32 entries are exploratory; their cross\-process reproducibility remains unverified\. None of the four main event configurations differs significantly from the original continuous\-activation control after Holm correction at the 0\.05 level; this does not establish statistical equivalence\.
## Appendix HExpressive range of the event code
We separately examine the representational capacity of power\-of\-two increments using trainable thresholds whose positions are parameterized separately from the emitted increments\. Each ordered threshold sets where an increment is triggered, while the increment is specified by its own signed power\-of\-two code; its magnitude is not constrained to equal the threshold\. This construction is distinct from the single\-threshold recurrence used in the VLA projections; its formal definition is given in Appendix[B](https://arxiv.org/html/2610.33658#A2)\. With 32 thresholds and at most four signed power\-of\-two terms per increment, it approximates a clipped rectified linear unit \(ReLU\) scaled by 1/4, sigmoid, and hyperbolic tangent \(tanh\) with root mean square error \(RMSE\) values of 0\.020, 0\.033, and 0\.045, respectively \(Fig\.[6](https://arxiv.org/html/2610.33658#A8.F6)\)\. Threshold placement controls resolution along the input axis, while the available power\-of\-two terms constrain the output increments\. These function\-fitting results illustrate the expressive range of the event code\. The ability of trainable thresholds to shape nonlinear responses motivates further investigation of this direction\.
Figure 6:Function approximation with trainable threshold positions and separately parameterized power\-of\-two increments \(Appendix[B](https://arxiv.org/html/2610.33658#A2)\)\. Orange curves approximate the target functions shown in dark lines using 32 ordered thresholds and at most four signed power\-of\-two terms per increment\. The respective RMSE values are 0\.020, 0\.033, and 0\.045\.Table 8:Paired statistical comparisons\. A and B are success rates \(%\);Δ=B−A\\Delta=B\-Ais in percentage points\. For F1 and the first nine E rows, A is the 96\.70% continuous control; for F2, A is the 96\.25% matched\-budget control\. Other E rows name their reference configuration\.ppis the unadjusted exact value;pHolmp\_\{\\mathrm\{Holm\}\}is reported only for F1 and F2\. The two STE rows correspond to separately fine\-tuned final checkpoints\. “BF16 membrane” distinguishes the precision sweeps from the main configurations with FP32 membrane state\.Fam\.Configuration B / reference AA \(%\)B \(%\)Δ\\DeltabbccpppHolmp\_\{\\mathrm\{Holm\}\}F1HeartbeatT=4T=4, identity STE96\.7096\.90\+0\.2038420\.7381\.000F1HeartbeatT=4T=4, magnitude STE96\.7096\.90\+0\.2038420\.7381\.000EHeartbeatT=4T=4FP8/FP32 \(archived\)96\.7097\.00\+0\.3040460\.590—F1HeartbeatT=4T=4FP8/A2496\.7097\.50\+0\.8038540\.1170\.704F1Standard modeT=2T=296\.7096\.35−\-0\.3562550\.5791\.000F1HeartbeatT=2T=2main96\.7097\.25\+0\.5540510\.2941\.000EHeartbeatT=2T=2FP8/FP32 \(archived\)96\.7096\.90\+0\.2043470\.752—F1Standard modeT=1T=1BF1696\.7096\.90\+0\.2044480\.7551\.000EHeartbeatT=2T=2BF16 membrane,θ=2−16\\theta=\{2\}^\{\-16\}96\.7097\.15\+0\.4538470\.386—EHeartbeatT=4T=4BF16 membrane,θ=2−16\\theta=\{2\}^\{\-16\}96\.7097\.20\+0\.5033430\.302—EHeartbeatT=2T=2BF16 membrane,θ=2−8\\theta=\{2\}^\{\-8\}96\.7097\.05\+0\.3543500\.534—EHeartbeatT=4T=4BF16 membrane,θ=2−8\\theta=\{2\}^\{\-8\}96\.7097\.20\+0\.5035450\.314—ET=1T=1FP8 E4M3FN,θ=2−16\\theta=\{2\}^\{\-16\}96\.7097\.25\+0\.5540510\.294—ET=1T=1FP8 E4M3FN,θ=2−8\\theta=\{2\}^\{\-8\}96\.7096\.35−\-0\.3557500\.562—ET=1T=1FP8 E4M3FN,θ=2−4\\theta=\{2\}^\{\-4\}96\.7097\.05\+0\.3547540\.551—F2Standard modeT=1T=1BF1696\.2596\.90\+0\.6544570\.2320\.284F2HeartbeatT=2T=2main96\.2597\.25\+1\.0036560\.0470\.141F2HeartbeatT=4T=4magnitude STE96\.2596\.90\+0\.6527400\.1420\.284ET=1T=1FP8 / BF16 weights,θ=2−16\\theta=\{2\}^\{\-16\}96\.9097\.25\+0\.3540470\.520—ET=1T=1FP8 / BF16 weights,θ=2−8\\theta=\{2\}^\{\-8\}96\.9096\.35−\-0\.5552410\.300—ET=1T=1FP8 / BF16 weights,θ=2−4\\theta=\{2\}^\{\-4\}96\.9097\.05\+0\.1540430\.826—ET=2T=2BF16 membrane / main,θ=2−16\\theta=\{2\}^\{\-16\}97\.2597\.15−\-0\.1040380\.910—ET=4T=4BF16 membrane / main,θ=2−16\\theta=\{2\}^\{\-16\}96\.9097\.20\+0\.3018240\.441—ET=2T=2BF16 membrane / main,θ=2−8\\theta=\{2\}^\{\-8\}97\.2597\.05−\-0\.2039350\.728—ET=4T=4BF16 membrane / main,θ=2−8\\theta=\{2\}^\{\-8\}96\.9097\.20\+0\.3022280\.480—
## Appendix IThreshold and Precision Sweeps
The two sweeps below reuse fixed checkpoints without further fine\-tuning\. Each configuration is evaluated on 500 episodes per suite\. Event statistics are computed for each precision path separately\.
Standard mode atT=1T=1with BF16 weights is the shared single\-step configuration reported in Table[1](https://arxiv.org/html/2610.33658#S5.T1)\. Starting from the continuous\-activation checkpoint, it uses the magnitude STE and 5,000 optimizer updates at effective batch size 256\. Success rates are 99\.2% on Spatial, 98\.4% on Object, 97\.6% on Goal, and 92\.4% on Long\-Horizon, giving 96\.90% overall \(1,938/2,000\)\.
Table 9:Heartbeat with BF16 membrane state and explicit thresholds, using fixed checkpoints and BF16 weights without further fine\-tuning\. The implementation’s four\-bit threshold\-selection index mapsc=15c=15toθ=2−16\\theta=\{2\}^\{\-16\}andc=7c=7toθ=2−8\\theta=\{2\}^\{\-8\}; it is not the event\-exponent field\.Δ\\Deltais relative to the main Heartbeat configuration at the sameTT, which uses FP32 membrane state andθ=2−16\\theta=\{2\}^\{\-16\}\. Rates are percentages; differences are percentage points\.TTθ\\thetaSpatialObjectGoalLong\-H\.OverallΔ\\Delta22−16\{2\}^\{\-16\}99\.498\.897\.692\.897\.15−\-0\.1022−8\{2\}^\{\-8\}98\.298\.698\.493\.097\.05−\-0\.2042−16\{2\}^\{\-16\}99\.497\.698\.893\.097\.20\+\+0\.3042−8\{2\}^\{\-8\}98\.898\.299\.092\.897\.20\+\+0\.30Table 10:Standard mode atT=1T=1with FP8 E4M3FN weights and three explicit thresholds, using the finalT=1T=1checkpoint without further fine\-tuning and a static power\-of\-two scale per weight tensor\.Δ\\Deltais relative to the 96\.90% BF16\-weightT=1T=1result\. Rates are percentages; differences are percentage points\.θ\\thetaSpatialObjectGoalLong\-H\.OverallΔ\\Delta2−16\{2\}^\{\-16\}98\.898\.698\.093\.697\.25\+\+0\.352−8\{2\}^\{\-8\}98\.298\.097\.691\.696\.35−\-0\.552−4\{2\}^\{\-4\}98\.697\.697\.894\.297\.05\+\+0\.15The BF16\-membrane sweep changes overall success by−\-0\.20 to \+0\.30 percentage points relative to the corresponding main Heartbeat configuration\. The FP8\-weight sweep changes success by−\-0\.55 to \+0\.35 points relative to the BF16\-weight single\-step configuration\. These fixed\-checkpoint results describe sensitivity to the tested thresholds and numerical formats\. The sweep comparisons are exploratory and fall outside the two corrected families in Appendix[G](https://arxiv.org/html/2610.33658#A7)\.
## References
- \[1\]K\. Black, N\. Brown, D\. Driess,et al\.\(2024\)π\_0\\pi\\\_0: A vision\-language\-action flow model for general robot control\.arXiv preprint arXiv:2410\.24164\.Cited by:[§1](https://arxiv.org/html/2610.33658#S1.p1.1),[§4](https://arxiv.org/html/2610.33658#S4.p1.1)\.
- \[2\]Physical Intelligence, K\. Black, N\. Brown,et al\.\(2025\)π\_0\.5\\pi\\\_\{0\.5\}: A vision\-language\-action model with open\-world generalization\.arXiv preprint arXiv:2504\.16054\.Cited by:[§1](https://arxiv.org/html/2610.33658#S1.p1.1),[§4](https://arxiv.org/html/2610.33658#S4.p1.1)\.
- \[3\]A\. Brohan, N\. Brown, J\. Carbajal,et al\.\(2023\)RT\-2: Vision\-language\-action models transfer web knowledge to robotic control\.arXiv preprint arXiv:2307\.15818\.Cited by:[§1](https://arxiv.org/html/2610.33658#S1.p1.1)\.
- \[4\]M\. J\. Kim, K\. Pertsch, S\. Karamcheti,et al\.\(2024\)OpenVLA: An open\-source vision\-language\-action model\.arXiv preprint arXiv:2406\.09246\.Cited by:[§1](https://arxiv.org/html/2610.33658#S1.p1.1)\.
- \[5\]W\. Gerstner, W\. M\. Kistler, R\. Naud, and L\. Paninski\(2014\)Neuronal Dynamics: From Single Neurons to Networks and Models of Cognition\.Cambridge University Press\.External Links:[Document](https://dx.doi.org/10.1017/CBO9781107447615)Cited by:[§1](https://arxiv.org/html/2610.33658#S1.p2.1),[§2\.1](https://arxiv.org/html/2610.33658#S2.SS1.p1.1),[§2\.1](https://arxiv.org/html/2610.33658#S2.SS1.p5.1)\.
- \[6\]L\. Lapicque\(1907\)Recherches quantitatives sur l’excitation électrique des nerfs traitée comme une polarisation\.Journal de Physiologie et de Pathologie Générale9,pp\. 620–635\.Note:English translation by N\. Brunel and M\. C\. W\. van Rossum, Biological Cybernetics, 97:341–349, 2007, doi:10\.1007/s00422\-007\-0189\-6Cited by:[§1](https://arxiv.org/html/2610.33658#S1.p2.1),[§2\.1](https://arxiv.org/html/2610.33658#S2.SS1.p1.1)\.
- \[7\]N\. Brunel and M\. C\. W\. van Rossum\(2007\)Lapicque’s 1907 paper: From frogs to integrate\-and\-fire\.Biological Cybernetics97\(5–6\),pp\. 337–339\.External Links:[Document](https://dx.doi.org/10.1007/s00422-007-0190-0)Cited by:[§1](https://arxiv.org/html/2610.33658#S1.p2.1),[§2\.1](https://arxiv.org/html/2610.33658#S2.SS1.p1.1)\.
- \[8\]S\. Wang, M\. Zhang, M\. Liu, W\. Dai, D\. Zhang, J\. Zhang, Y\. Shan, Z\. Zhou, and Y\. Yang\(2026\)Spike\-driven Vision\-Language\-Action Model\.arXiv preprint arXiv:2609\.39514\.Cited by:[Table 3](https://arxiv.org/html/2610.33658#A4.T3.6.2.1.1.1),[Table 4](https://arxiv.org/html/2610.33658#A4.T4.5.2.1.1.1),[§1](https://arxiv.org/html/2610.33658#S1.p2.1),[§2\.4](https://arxiv.org/html/2610.33658#S2.SS4.p1.1)\.
- \[9\]Y\. Lyu, J\. Li, M\. Xu, and Y\. Wu\(2026\)DS\-VLA: A Dendritic\-inspired Vision\-Language\-Action Model for Robust Action Control\.arXiv preprint arXiv:2609\.32253\.Cited by:[Table 3](https://arxiv.org/html/2610.33658#A4.T3.6.3.1.1.1),[Table 4](https://arxiv.org/html/2610.33658#A4.T4.5.3.1.1.1),[§1](https://arxiv.org/html/2610.33658#S1.p2.1),[§2\.4](https://arxiv.org/html/2610.33658#S2.SS4.p2.1)\.
- \[10\]F\. Gabbiani, H\. G\. Krapp, C\. Koch, and G\. Laurent\(2002\)Multiplicative computation in a visual neuron sensitive to looming\.Nature420,pp\. 320–324\.External Links:[Document](https://dx.doi.org/10.1038/nature01190)Cited by:[§1](https://arxiv.org/html/2610.33658#S1.p3.1)\.
- \[11\]Y\. Shu, A\. Hasenstaub, A\. Duque, Y\. Yu, and D\. A\. McCormick\(2006\)Modulation of intracortical synaptic potentials by presynaptic somatic membrane potential\.Nature441,pp\. 761–765\.External Links:[Document](https://dx.doi.org/10.1038/nature04720)Cited by:[§1](https://arxiv.org/html/2610.33658#S1.p3.1)\.
- \[12\]B\. Liu, Y\. Zhu, C\. Gao, Y\. Feng, Q\. Liu, Y\. Zhu, and P\. Stone\(2023\)LIBERO: Benchmarking knowledge transfer for lifelong robot learning\.InAdvances in Neural Information Processing Systems,Vol\.36,pp\. 44776–44791\.Cited by:[§1](https://arxiv.org/html/2610.33658#S1.p6.1),[§5\.1](https://arxiv.org/html/2610.33658#S5.SS1.p1.1)\.
- \[13\]A\. Destexhe, Z\. F\. Mainen, and T\. J\. Sejnowski\(1994\)An efficient method for computing synaptic conductances based on a kinetic model of receptor binding\.Neural Computation6\(1\),pp\. 14–18\.External Links:[Document](https://dx.doi.org/10.1162/neco.1994.6.1.14)Cited by:[§2\.1](https://arxiv.org/html/2610.33658#S2.SS1.p4.1)\.
- \[14\]M\. V\. Tsodyks and H\. Markram\(1997\)The neural code between neocortical pyramidal neurons depends on neurotransmitter release probability\.Proceedings of the National Academy of Sciences94\(2\),pp\. 719–723\.External Links:[Document](https://dx.doi.org/10.1073/pnas.94.2.719)Cited by:[§2\.1](https://arxiv.org/html/2610.33658#S2.SS1.p4.1)\.
- \[15\]Y\. Cao, Y\. Chen, and D\. Khosla\(2015\)Spiking Deep Convolutional Neural Networks for Energy\-Efficient Object Recognition\.International Journal of Computer Vision113\(1\),pp\. 54–66\.External Links:[Document](https://dx.doi.org/10.1007/s11263-014-0788-3)Cited by:[§2\.1](https://arxiv.org/html/2610.33658#S2.SS1.p5.1)\.
- \[16\]A\. Sengupta, Y\. Ye, R\. Wang, C\. Liu, and K\. Roy\(2019\)Going Deeper in Spiking Neural Networks: VGG and Residual Architectures\.Frontiers in Neuroscience13,pp\. 95\.External Links:[Document](https://dx.doi.org/10.3389/fnins.2019.00095)Cited by:[§2\.1](https://arxiv.org/html/2610.33658#S2.SS1.p5.1),[§6](https://arxiv.org/html/2610.33658#S6.p2.1)\.
- \[17\]E\. O\. Neftci, H\. Mostafa, and F\. Zenke\(2019\)Surrogate gradient learning in spiking neural networks: Bringing the power of gradient\-based optimization to spiking neural networks\.IEEE Signal Processing Magazine36\(6\),pp\. 51–63\.External Links:[Document](https://dx.doi.org/10.1109/MSP.2019.2931595)Cited by:[Appendix B](https://arxiv.org/html/2610.33658#A2.p3.1),[§2\.2](https://arxiv.org/html/2610.33658#S2.SS2.p1.1),[§5](https://arxiv.org/html/2610.33658#S5.p1.1)\.
- \[18\]W\. B\. Levy and R\. A\. Baxter\(1996\)Energy efficient neural codes\.Neural Computation8\(3\),pp\. 531–543\.External Links:[Document](https://dx.doi.org/10.1162/neco.1996.8.3.531)Cited by:[§2\.3](https://arxiv.org/html/2610.33658#S2.SS3.p1.1)\.
- \[19\]J\. J\. Harris, R\. Jolivet, E\. Engl, and D\. Attwell\(2015\)Energy\-efficient information transfer by visual pathway synapses\.Current Biology25\(24\),pp\. 3151–3160\.External Links:[Document](https://dx.doi.org/10.1016/j.cub.2015.10.063)Cited by:[§2\.3](https://arxiv.org/html/2610.33658#S2.SS3.p1.1)\.
- \[20\]D\. Miyashita, E\. H\. Lee, and B\. Murmann\(2016\)Convolutional neural networks using logarithmic data representation\.arXiv preprint arXiv:1603\.01025\.Cited by:[§2\.3](https://arxiv.org/html/2610.33658#S2.SS3.p2.1)\.
- \[21\]M\. Elhoushi, Z\. Chen, F\. Shafiq, Y\. H\. Tian, and J\. Y\. Li\(2021\)DeepShift: Towards multiplication\-less neural networks\.InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops,pp\. 2359–2368\.Cited by:[§2\.3](https://arxiv.org/html/2610.33658#S2.SS3.p2.1)\.
- \[22\]H\. Chen, Y\. Wang, C\. Xu, B\. Shi, C\. Xu, Q\. Tian, and C\. Xu\(2020\)AdderNet: Do we really need multiplications in deep learning?\.InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition,pp\. 1468–1477\.External Links:[Document](https://dx.doi.org/10.1109/CVPR42600.2020.00154)Cited by:[§2\.3](https://arxiv.org/html/2610.33658#S2.SS3.p2.1)\.
- \[23\]Intel Labs\(2021\)Taking Neuromorphic Computing to the Next Level with Loihi 2\.Technology briefIntel Corporation\.External Links:[Link](https://download.intel.com/newsroom/2021/new-technologies/neuromorphic-computing-loihi-2-brief.pdf)Cited by:[§2\.3](https://arxiv.org/html/2610.33658#S2.SS3.p3.1)\.
- \[24\]X\. Zhai, B\. Mustafa, A\. Kolesnikov, and L\. Beyer\(2023\)Sigmoid loss for language image pre\-training\.arXiv preprint arXiv:2303\.15343\.Cited by:[§4\.1](https://arxiv.org/html/2610.33658#S4.SS1.p1.1)\.
- \[25\]L\. Beyer, A\. Steiner, A\. S\. Pinto,et al\.\(2024\)PaliGemma: A versatile 3B VLM for transfer\.arXiv preprint arXiv:2407\.07726\.Cited by:[§4\.1](https://arxiv.org/html/2610.33658#S4.SS1.p1.1)\.
- \[26\]M\. Horowitz\(2014\)Computing’s energy problem \(and what we can do about it\)\.InIEEE International Solid\-State Circuits Conference Digest of Technical Papers,pp\. 10–14\.External Links:[Document](https://dx.doi.org/10.1109/ISSCC.2014.6757323)Cited by:[§6](https://arxiv.org/html/2610.33658#S6.p2.1)\.
- \[27\]P\. Micikeviciuset al\.\(2022\)FP8 formats for deep learning\.arXiv preprint arXiv:2209\.05433\.Cited by:[Appendix E](https://arxiv.org/html/2610.33658#A5.p1.1)\.
- \[28\]I\. Loshchilov and F\. Hutter\(2019\)Decoupled weight decay regularization\.InInternational Conference on Learning Representations,Note:arXiv:1711\.05101Cited by:[Table 6](https://arxiv.org/html/2610.33658#A5.T6.4.9.2.1.1)\.
- \[29\]Q\. McNemar\(1947\)Note on the sampling error of the difference between correlated proportions or percentages\.Psychometrika12,pp\. 153–157\.External Links:[Document](https://dx.doi.org/10.1007/BF02295996)Cited by:[Appendix G](https://arxiv.org/html/2610.33658#A7.p1.1)\.
- \[30\]S\. Holm\(1979\)A simple sequentially rejective multiple test procedure\.Scandinavian Journal of Statistics6\(2\),pp\. 65–70\.External Links:[Link](https://www.jstor.org/stable/4615733)Cited by:[Appendix G](https://arxiv.org/html/2610.33658#A7.p1.1)\.相似文章
SpikingVLA:异步脉冲视觉-语言-动作模型
SpikingVLA 提出了一种 ANN 到 SNN 的转换框架,采用树突脉冲发放(Dendritic Integrate-and-Fire)神经元和异步执行机制,实现低功耗、低延迟的脉冲 VLA 推理,相比现有脉冲 VLA 方法,导航成功率显著提升,首次动作延迟降低至原来的 1/11.2。
OneVL:基于视觉语言解释的单步隐式推理与规划
# 论文页面 - OneVL:基于视觉语言解释的单步隐式推理与规划 来源:[https://huggingface.co/papers/2604.18486](https://huggingface.co/papers/2604.18486) 发布于 4月20日 [\#1 每日论文](https://huggingface.co/papers/date/2026-04-21) 作者:, , , , , , , , , , , , , , , , , , , , ## 摘要 OneVL 提出了一个统一的视觉-语言-行动框架,通过整合语言和 v
使用 LFM2.5-VL-DSpark 加速视觉语言模型
今天,我们为视觉语言模型 (VLM) LFM2.5-VL-3B 发布了一个实验性的 DSpark 草稿模型,它增加了一个推测解码路径,以实现更快的推理速度,同时内存成本最小。
视觉思考-视觉-语言-行动策略:视觉中间推理实现高效低延迟
视觉思考-视觉-语言-行动策略(VisualThink-VLA)引入了一种用于视觉-语言-行动策略的视觉中间推理框架,该框架保留了空间精度,并相比基于文本的推理显著降低了延迟,在机器人操作基准测试中实现了亚秒级推理和领先的成功率。
TurboVLA:在RTX 4090上以32 Hz运行且显存占用小于1 GB的实时视觉-语言-动作模型
TurboVLA提出了一种新的视觉-语言-动作范式,直接将视觉和语言映射到动作,在LIBERO上仅用0.2B参数就达到了97.7%的成功率,并在消费级GPU上以32 Hz实现实时推理,显著降低了计算成本。