ODE-Based Transformer Decoders for Iterative Sign Language Translation

arXiv cs.CL Papers

Summary

This paper proposes ODE-based Transformer decoders using Runge-Kutta integration methods to improve iterative refinement for sign language translation, achieving better BLEU scores than the IPSLT baseline without increasing model size.

arXiv:2608.11352v1 Announce Type: new Abstract: Sign language translation has achieved strong results with Transformer architectures, yet recent improvements largely rely on scaling model capacity at the cost of increased computation. We propose a parameter-efficient alternative that improves expressiveness without increasing model size. Rather than scaling capacity, we focus on enhancing the update dynamics of iterative refinement decoders, where each refinement step corresponds to one internal decoder iteration that progressively improves the latent representation before translation generation. We reinterpret residual refinement updates from an Ordinary Differential Equation (ODE) perspective and replace them with higher-order numerical integration schemes, namely Runge--Kutta methods (RK-2 and RK-4). These methods perform multiple function evaluations within each refinement step to produce more accurate and stable representation updates without adding decoder parameters. To the best of our knowledge, this is the first application of ODE-inspired update dynamics to sign language translation. RK-2 achieves 22.96 BLEU-4 on the PHOENIX-2014-T test set and 19.34 BLEU-4 on the CSL-Daily test set, outperforming the IPSLT baseline on both benchmarks, with fewer decoder layers and refinement iterations on CSL-Daily. These results suggest that stronger refinement dynamics can improve translation performance under parameter-efficient decoder designs, providing a complementary alternative to conventional model scaling.
Original Article
View Cached Full Text

Cached at: 08/13/26, 03:26 PM

# ODE-Based Transformer Decoders for Iterative Sign Language Translation
Source: [https://arxiv.org/html/2608.11352](https://arxiv.org/html/2608.11352)
###### Abstract

Sign language translation has achieved strong results with Transformer architectures, yet recent improvements largely rely on scaling model capacity at the cost of increased computation\. We propose a parameter\-efficient alternative that improves expressiveness without increasing model size\. Rather than scaling capacity, we focus on enhancing the update dynamics of iterative refinement decoders, where each refinement step corresponds to one internal decoder iteration that progressively improves the latent representation before translation generation\. We reinterpret residual refinement updates from an Ordinary Differential Equation \(ODE\) perspective and replace them with higher\-order numerical integration schemes, namely Runge–Kutta methods \(RK\-2 and RK\-4\)\. These methods perform multiple function evaluations within each refinement step to produce more accurate and stable representation updates without adding decoder parameters\. To the best of our knowledge, this is the first application of ODE\-inspired update dynamics to sign language translation\. RK\-2 achieves 22\.96 BLEU\-4 on the PHOENIX\-14T test set and 19\.34 BLEU\-4 on the CSL\-Daily test set, outperforming the IPSLT baseline on both benchmarks, with fewer decoder layers and refinement iterations on CSL\-Daily\. These results suggest that stronger refinement dynamics can improve translation performance under parameter\-efficient decoder designs, providing a complementary alternative to conventional model scaling\.

###### Keywords:

Sign Language Translation Iterative Refinement Ordinary Differential Equations Runge–Kutta Methods

## 1Introduction

![Refer to caption](https://arxiv.org/html/2608.11352v1/ode2.png)Figure 1:Overview of the proposed architecture\. A frozen visual encoder extracts features, followed by stacked Transformer encoder layers\. At each stage, representations are decoded by ODE\-based Transformer decoders within an iterative refinement framework\.Sign language translation \(SLT\) aims to generate fluent spoken\-language text directly from continuous visual sign language input\. SLT can be formulated as a gloss\-based approach relying on intermediate gloss representations or as a gloss\-free approach that directly maps visual input to text, where the latter offers improved scalability by eliminating costly gloss annotations\. Gloss\-free SLT requires jointly modeling fine\-grained spatiotemporal cues, such as hand shape, motion, and facial expressions, and capturing long\-range dependencies, while the lack of explicit visual–textual alignment and the linguistic differences between sign and spoken languages further complicate the task\.

Recent progress in SLT has been largely driven by scaling model capacity and leveraging large pretrained components, such as powerful visual encoders and large language models\. While these strategies yield strong performance gains, they increase computational cost, and comparatively less attention has been given to how representations are updated across layers\.

Transformer\-based architectures form the foundation of most modern SLT systems, where representations are updated across layers through residual connections\. Such connections can be viewed as discretizations of an underlying Ordinary Differential Equation \(ODE\), where each layer performs a single first\-order Euler integration step\[[25](https://arxiv.org/html/2608.11352#bib.bib53),[58](https://arxiv.org/html/2608.11352#bib.bib57)\]\. This first\-order formulation may limit the accuracy and stability of representation evolution, suggesting that more advanced numerical integration methods could improve the quality of representation updates\. This viewpoint provides an alternative to scaling, where improvements arise from better update dynamics rather than larger models\.

In this work, we propose a parameter\-efficient approach that enhances model expressiveness by improving update dynamics instead of increasing model capacity\. To the best of our knowledge, this is the first work to introduce an ODE\-based perspective into SLT\. Building on an iterative refinement framework, we replace standard residual decoder updates with higher\-order Runge–Kutta methods \(RK\-2 and RK\-4\), which approximate the underlying dynamics using multiple function evaluations per step, resulting in more accurate and stable updates\.

We evaluate the proposed approach on PHOENIX\-14T and CSL\-Daily\. The results demonstrate that ODE\-guided update dynamics can improve test performance without adding decoder parameters\. These outcomes suggest that enhancing the quality of iterative representation updates is a promising parameter\-efficient direction for SLT, complementary to conventional model scaling\.

## 2Related Work

### 2\.1Sign Language Translation

Sign language translation \(SLT\) is a challenging task within the broader field of Sign Language Understanding \(SLU\), which aims to infer semantic meaning from visual sign language data\. Earlier work in SLU has largely focused on recognition: isolated sign recognition classifies individual signs from short clips\[[27](https://arxiv.org/html/2608.11352#bib.bib7),[43](https://arxiv.org/html/2608.11352#bib.bib8),[26](https://arxiv.org/html/2608.11352#bib.bib10),[61](https://arxiv.org/html/2608.11352#bib.bib11)\], while continuous sign recognition transcribes signing video into gloss sequences\[[19](https://arxiv.org/html/2608.11352#bib.bib12),[27](https://arxiv.org/html/2608.11352#bib.bib7),[20](https://arxiv.org/html/2608.11352#bib.bib13),[48](https://arxiv.org/html/2608.11352#bib.bib14)\], where glosses serve as intermediate representations approximating sign\-level annotations\.

SLT can be formulated either as an end\-to\-end gloss\-free task or as a gloss\-based framework that leverages gloss supervision, either explicitly or through auxiliary alignment objectives\[[8](https://arxiv.org/html/2608.11352#bib.bib15),[44](https://arxiv.org/html/2608.11352#bib.bib16)\]\. In explicit settings, gloss sequences are first predicted via continuous sign language recognition \(CSLR\) and subsequently mapped to spoken\-language text\[[56](https://arxiv.org/html/2608.11352#bib.bib20),[53](https://arxiv.org/html/2608.11352#bib.bib21),[11](https://arxiv.org/html/2608.11352#bib.bib22),[10](https://arxiv.org/html/2608.11352#bib.bib23),[7](https://arxiv.org/html/2608.11352#bib.bib1)\]\. While gloss supervision provides strong intermediate constraints due to its temporal alignment with sign language, it is labor\-intensive and requires domain expertise, limiting scalability\. Moreover, gloss annotations are typically unavailable in large\-scale open\-domain datasets such as YouTube\-SL25\[[45](https://arxiv.org/html/2608.11352#bib.bib17)\], OpenASL\[[42](https://arxiv.org/html/2608.11352#bib.bib18)\], YouTube\-ASL\[[47](https://arxiv.org/html/2608.11352#bib.bib19)\], and BOBSL\[[3](https://arxiv.org/html/2608.11352#bib.bib24)\], making gloss\-free approaches a more scalable alternative for end\-to\-end SLT\.

Due to the limited size of SLT datasets and the multimodal nature of the task, transfer learning and pretraining have become key strategies\. Most SLT frameworks decouple visual representation learning from language modeling, employing independently pretrained visual encoders and language decoders\[[10](https://arxiv.org/html/2608.11352#bib.bib23),[59](https://arxiv.org/html/2608.11352#bib.bib25),[49](https://arxiv.org/html/2608.11352#bib.bib26),[33](https://arxiv.org/html/2608.11352#bib.bib27)\]\. To mitigate the modality gap, recent approaches adopt visual–language pretraining with contrastive objectives and masked modeling\[[59](https://arxiv.org/html/2608.11352#bib.bib25)\], while gloss\-free settings introduce pseudo\-gloss pretraining\[[49](https://arxiv.org/html/2608.11352#bib.bib26)\]and gloss\-attention mechanisms\[[55](https://arxiv.org/html/2608.11352#bib.bib28)\]to approximate gloss supervision\.

Recent advances increasingly leverage large pretrained and foundation models\. On the language side, large language models such as GPT\[[49](https://arxiv.org/html/2608.11352#bib.bib26)\], LLaMA\[[23](https://arxiv.org/html/2608.11352#bib.bib32),[15](https://arxiv.org/html/2608.11352#bib.bib29)\], FlanT5\-XL\[[22](https://arxiv.org/html/2608.11352#bib.bib31)\], and mBART\[[12](https://arxiv.org/html/2608.11352#bib.bib30)\]are integrated as decoders or auxiliary supervisors\[[18](https://arxiv.org/html/2608.11352#bib.bib33)\], enhancing linguistic fluency and long\-range dependency modeling\. On the visual side, foundation models pretrained on large\-scale image or video corpora, including DINOv2\[[49](https://arxiv.org/html/2608.11352#bib.bib26),[17](https://arxiv.org/html/2608.11352#bib.bib34)\], CLIP\[[50](https://arxiv.org/html/2608.11352#bib.bib35),[22](https://arxiv.org/html/2608.11352#bib.bib31)\], and VideoMAE\[[22](https://arxiv.org/html/2608.11352#bib.bib31)\], provide strong spatiotemporal representations\. While these approaches achieve substantial gains, they typically rely on increased model capacity and large pretrained backbones, reflecting a broader trend of scaling\.

### 2\.2Transformers and Ordinary Differential Equation \(ODE\) Techniques

Transformer architectures have increasingly been interpreted from an ODE\-based perspective, where residual layers correspond to discrete integration steps of an underlying continuous transformation\. This view builds on earlier connections between Neural ODEs and equilibrium formulations of deep networks\[[9](https://arxiv.org/html/2608.11352#bib.bib55),[6](https://arxiv.org/html/2608.11352#bib.bib56)\], under which standard residual updates resemble first\-order numerical solvers, motivating more expressive update rules\.

Recent studies extend this perspective specifically to Transformers\. Zhong et al\.\[[58](https://arxiv.org/html/2608.11352#bib.bib57)\]analyze Transformer layers through a Neural ODE formulation, while Li et al\.\[[25](https://arxiv.org/html/2608.11352#bib.bib53)\]introduce Runge–Kutta\-inspired updates for sequence generation, replacing the first\-order residual step with higher\-order integration\. Tong et al\.\[[46](https://arxiv.org/html/2608.11352#bib.bib54)\]further explore continuous\-depth architectures, depth\-dependent parameterizations, and adaptive fine\-tuning to improve flexibility and stability\.

Prior work has primarily applied the ODE perspective to general sequence generation or conventional Transformer layer stacks\. In contrast, we study this formulation in the context of iterative SLT, where representations are repeatedly refined over multiple update steps\. Building on Li et al\.\[[25](https://arxiv.org/html/2608.11352#bib.bib53)\], we integrate Runge–Kutta updates into the refinement process\.

### 2\.3Iterative Refinement

Iterative refinement is a general strategy for improving predictions by repeatedly updating intermediate representations or outputs over multiple steps\. It appears across vision and language tasks in various forms, including progressive generative refinement\[[16](https://arxiv.org/html/2608.11352#bib.bib39),[1](https://arxiv.org/html/2608.11352#bib.bib37),[39](https://arxiv.org/html/2608.11352#bib.bib38),[2](https://arxiv.org/html/2608.11352#bib.bib48),[40](https://arxiv.org/html/2608.11352#bib.bib47)\], structural alignment optimization\[[29](https://arxiv.org/html/2608.11352#bib.bib41),[37](https://arxiv.org/html/2608.11352#bib.bib40),[30](https://arxiv.org/html/2608.11352#bib.bib42),[57](https://arxiv.org/html/2608.11352#bib.bib43)\], and self\-feedback mechanisms\[[32](https://arxiv.org/html/2608.11352#bib.bib44)\]\.

In Transformer architectures, refinement is commonly realized through recursive or weight\-shared designs, where the same block is applied multiple times and the effective depth is determined by the number of iterations\[[4](https://arxiv.org/html/2608.11352#bib.bib45),[51](https://arxiv.org/html/2608.11352#bib.bib46),[41](https://arxiv.org/html/2608.11352#bib.bib49)\]\. Related approaches, such as the Universal Transformer and depth\-adaptive variants, further explore iterative computation by reusing shared layers or dynamically adjusting computation depth\[[13](https://arxiv.org/html/2608.11352#bib.bib50),[14](https://arxiv.org/html/2608.11352#bib.bib51),[5](https://arxiv.org/html/2608.11352#bib.bib52)\]\.

In sign language translation, iterative refinement has been adopted to progressively improve decoding outputs across multiple steps\[[52](https://arxiv.org/html/2608.11352#bib.bib36)\]\. Similar strategies have also been explored in sign language production, where iterative updates refine generated sign sequences\[[24](https://arxiv.org/html/2608.11352#bib.bib61)\]\. These approaches improve what is refined or how many refinement steps are taken, while the update within each step remains a first\-order residual operation\. In contrast, we recast each refinement step as a higher\-order numerical integration of an underlying continuous transformation, producing a more accurate per\-step update without adding parameters or refinement steps, complementary to existing iterative refinement methods\.

## 3Methodology

We propose ODE\-guided decoders for sign language translation, building on the iterative refinement framework\[[52](https://arxiv.org/html/2608.11352#bib.bib36)\]and enhancing representation updates through higher\-order numerical integration schemes\. An overview of the proposed model architecture is illustrated in Fig\.[1](https://arxiv.org/html/2608.11352#S1.F1)\.

### 3\.1Visual Features

We extract 512\-dimensional frame\-level visual features using dataset\-specific ResNet\-18 backbones pretrained under the CSLR setting\. For PHOENIX\-14T, we use the ResNet\-18 backbone pretrained with the VAC framework\[[34](https://arxiv.org/html/2608.11352#bib.bib5)\]\. For CSL\-Daily, we use the ResNet\-18 backbone pretrained with the Self\-Emphasizing Network framework\[[21](https://arxiv.org/html/2608.11352#bib.bib58)\]\. To reduce training cost, the visual backbones are kept frozen during training\. The extracted visual embeddings are then processed by a stack of 1D temporal convolution and max\-pooling layers, which model local motion patterns and provide hierarchical temporal abstraction before the features are passed to the translation model\.

### 3\.2Initialization

In the initialization stage, an encoder–decoder pair generates an initial prediction from visual features\. The initial encoderE1E\_\{1\}processes the input features, and its representation is used to obtain the predictionY0Y\_\{0\}\. This representation is then passed to the iterative refinement module, where it serves as input to the subsequent encoding stage \(E2E\_\{2\}\)\. The initialization decoder is used only during training and is not involved in inference\.

### 3\.3Iterative Refinement

Building on the initial representation, we perform iterative refinement to progressively improve the model predictions\. The refinement stage is implemented using a dedicated encoder, denoted asE2E\_\{2\}, which is applied iteratively\. At each iterationkk, the model updates its representation by conditioning on both the visual featuresVVand the representation obtained from the previous iteration\. Specifically, given the previous representationHk−1H\_\{k\-1\}, the refinement encoderE2E\_\{2\}produces an updated representation

​Hk=E2​\(Hk−1,V\)\.\\mbox\{\}\\hfill H\_\{k\}=E\_\{2\}\(H\_\{k\-1\},V\)\.\\hfill\\mbox\{\}\(1\)
The updated representationHkH\_\{k\}in Eq\.[1](https://arxiv.org/html/2608.11352#S3.E1)is then passed to the decoder to generate the refined predictionYkY\_\{k\}\. This process is repeated forKKiterations, enabling progressive improvement of the model outputs\.

In both the initialization and iterative refinement stages, the encoder uses the attention module introduced in\[[55](https://arxiv.org/html/2608.11352#bib.bib28)\]in place of standard attention blocks\.

### 3\.4ODE\-Based Transformer Decoder

To improve the quality of representation updates, we reinterpret the Transformer decoder as a dynamical system and replace standard residual updates with higher\-order numerical integration schemes\.

In standard Transformers, each layer performs a residual update of the form:

​yt\+1=yt\+F⁡\(yt\)​\\mbox\{\}\\hfill y\_\{t\+1\}=y\_\{t\}\+F\(y\_\{t\}\)\\hfill\\mbox\{\}\(2\)which can be interpreted as a first\-order Euler discretization\. To obtain more accurate updates, we employ higher\-order Runge–Kutta methods, specifically second\-order \(RK\-2\) and fourth\-order \(RK\-4\) schemes\.

##### Post\-update LayerNorm\.

After computing the RK\-style update at steptt, we optionally apply Layer Normalization to the updated latent representation\. For notational simplicity, we write the RK update increment using the same form as Eq\.[2](https://arxiv.org/html/2608.11352#S3.E2), i\.e\.,F⁡\(yt\)F\(y\_\{t\}\), whereF⁡\(⋅\)F\(\\cdot\)denotes the effective update\.

​y~t\+1=yt\+F⁡\(yt\),yt\+1=LayerNorm⁡\(y~t\+1\)\.\\hskip 0\.0pt\\mbox\{\}\\hfill\\tilde\{y\}\_\{t\+1\}=y\_\{t\}\+F\(y\_\{t\}\),\\qquad y\_\{t\+1\}=\\mathrm\{LayerNorm\}\(\\tilde\{y\}\_\{t\+1\}\)\.\\hfill\\mbox\{\}This post\-update normalization can be used to stabilize the iterative refinement process and reduce scale variation across refinement steps\.

##### Direct RK\-2 Formulation \(Method 1\)

Following prior work\[[25](https://arxiv.org/html/2608.11352#bib.bib53)\], we adopt a direct RK\-2 formulation by treating the Transformer decoder layer as the transformation functionF⁡\(⋅\)F\(\\cdot\)\. The update is computed as:

​F1=F⁡\(yt\),F2=F⁡\(yt\+F1\),yt\+1=yt\+12​\(F1\+F2\)\.\\hskip 0\.0pt\\mbox\{\}\\hfill F\_\{1\}=F\(y\_\{t\}\),\\quad F\_\{2\}=F\(y\_\{t\}\+F\_\{1\}\),\\quad y\_\{t\+1\}=y\_\{t\}\+\\tfrac\{1\}\{2\}\\left\(F\_\{1\}\+F\_\{2\}\\right\)\.\\hfill\\mbox\{\}This formulation directly applies RK\-2 by evaluating the decoder layer multiple times, and remains compatible with standard Transformer decoder layers without architectural modifications\.

##### Residual\-Compatible RK\-2 Formulation \(Method 2\)

Since Transformer layers inherently follow a residual structure as shown in Eq\.[2](https://arxiv.org/html/2608.11352#S3.E2), they can be interpreted as implementing a first\-order \(Euler\) update, whereF⁡\(yt\)F\(y\_\{t\}\)corresponds to the residual transformation\. In practice, a Transformer decoder layerg⁡\(⋅\)g\(\\cdot\)produces an output of the formg⁡\(yt\)=yt\+F⁡\(yt\)g\(y\_\{t\}\)=y\_\{t\}\+F\(y\_\{t\}\), allowing the update function to be implicitly recovered as:

​F​\(yt\)=g⁡\(yt\)−yt\.\\hskip 0\.0pt\\mbox\{\}\\hfill F\(y\_\{t\}\)=g\(y\_\{t\}\)\-y\_\{t\}\.\\hfill\\mbox\{\}
Building on this observation, we derive the RK\-2 update increments directly from the residual behavior of the decoder layer, without explicitly definingF⁡\(⋅\)F\(\\cdot\)\. Specifically, letg⁡\(⋅\)g\(\\cdot\)denote a Transformer decoder layer with residual connections\. We compute:

y~1=g\(yt\),F1=y~1−yt,\\hskip 0\.0pt\\mbox\{\}\\hfill\\tilde\{y\}\_\{1\}=g\(y\_\{t\}\),\\quad F\_\{1\}=\\tilde\{y\}\_\{1\}\-y\_\{t\},\\hfill\\mbox\{\}y~2=g\(yt\+F1\),F2=y~2−\(yt\+F1\),\\hskip 0\.0pt\\mbox\{\}\\hfill\\tilde\{y\}\_\{2\}=g\(y\_\{t\}\+F\_\{1\}\),\\quad F\_\{2\}=\\tilde\{y\}\_\{2\}\-\(y\_\{t\}\+F\_\{1\}\),\\hfill\\mbox\{\}and update the representation as:

​yt\+1=yt\+12​\(F1\+F2\)\.\\hskip 0\.0pt\\mbox\{\}\\hfill y\_\{t\+1\}=y\_\{t\}\+\\tfrac\{1\}\{2\}\\left\(F\_\{1\}\+F\_\{2\}\\right\)\.\\hfill\\mbox\{\}
This formulation naturally aligns with the residual structure of Transformers, allowing RK\-2 dynamics to be integrated without modifying the architecture or introducing additional parameters\.

##### RK\-4 Extension

We further extend both formulations to the fourth\-order Runge–Kutta \(RK\-4\) scheme, which performs four intermediate evaluations within a single update step to obtain a more accurate estimate of the underlying transformation\.

For the direct formulation \(Method 1\), whereF⁡\(⋅\)F\(\\cdot\)denotes the decoder\-layer transformation, the update is computed as:

​F1=F⁡\(yt\),F2=F⁡\(yt\+12​F1\),F3=F⁡\(yt\+12​F2\),F4=F⁡\(yt\+F3\),yt\+1=yt\+16​\(F1\+2​F2\+2​F3\+F4\)\.​\\mbox\{\}\\hfill\\begin\{gathered\}F\_\{1\}=F\(y\_\{t\}\),\\\\ F\_\{2\}=F\\left\(y\_\{t\}\+\\tfrac\{1\}\{2\}F\_\{1\}\\right\),\\\\ F\_\{3\}=F\\left\(y\_\{t\}\+\\tfrac\{1\}\{2\}F\_\{2\}\\right\),\\\\ F\_\{4\}=F\\left\(y\_\{t\}\+F\_\{3\}\\right\),\\\\ y\_\{t\+1\}=y\_\{t\}\+\\tfrac\{1\}\{6\}\\left\(F\_\{1\}\+2F\_\{2\}\+2F\_\{3\}\+F\_\{4\}\\right\)\.\\end\{gathered\}\\hfill\\mbox\{\}\(3\)
For the residual\-compatible formulation \(Method 2\), we compute each intermediate increment from the residual behavior of the decoder layerg⁡\(⋅\)g\(\\cdot\)\. That is, for each intermediate inputy^i\\hat\{y\}\_\{i\}, the corresponding increment is obtained asFi=g⁡\(y^i\)−y^iF\_\{i\}=g\(\\hat\{y\}\_\{i\}\)\-\\hat\{y\}\_\{i\}, wherey^i\\hat\{y\}\_\{i\}follows the same RK\-4 intermediate states used above\. This allows the RK\-4 update to be applied without removing the residual structure already present in Transformer decoder layers\.

In our RK\-based decoder, all stage evaluations \(F1F\_\{1\},F2F\_\{2\}in RK\-2 andF1,…,F4F\_\{1\},\\ldots,F\_\{4\}in RK\-4\) are computed by repeated applications of the same decoder functionfθf\_\{\\theta\}\. Increasing the RK order therefore increases the number of decoder evaluations per refinement step without introducing additional decoder parameters\.

### 3\.5Training Objective

We train the model with supervised cross\-entropy and an iteration\-wise distillation objective, which we refer to as the iterative distillation loss \(IDL\)\. Cross\-entropy is applied to the initialization output \(E1E\_\{1\}\) and to the final refined prediction from the refinement stage \(E2E\_\{2\}\)\. During refinement, IDL is implemented as a Kullback–Leibler divergence from each intermediate refinement prediction to the final refinement prediction, where the last refinement step acts as the teacher distribution\. We sum the IDL terms across refinement steps to encourage consistent refinement trajectories and reduce oscillations\.

## 4Experiments

### 4\.1Implementation Details

Dataset\.We evaluate on PHOENIX\-14T\[[7](https://arxiv.org/html/2608.11352#bib.bib1)\], a German Sign Language benchmark derived from weather forecast broadcasts, and CSL\-Daily\[[60](https://arxiv.org/html/2608.11352#bib.bib2)\], a large\-scale Chinese Sign Language dataset covering daily\-life topics with a broader vocabulary\. For both datasets, models are trained on video–translation pairs and evaluated against reference translations without ground\-truth gloss supervision\.

Evaluation Protocols\.We evaluate translation quality using BLEU\[[35](https://arxiv.org/html/2608.11352#bib.bib3)\], computed with SacreBLEU\[[38](https://arxiv.org/html/2608.11352#bib.bib60)\], and ROUGE\[[28](https://arxiv.org/html/2608.11352#bib.bib4)\]\.

Training Settings\.The proposed model was implemented using the PyTorch\[[36](https://arxiv.org/html/2608.11352#bib.bib9)\]framework and trained with the AdamW\[[31](https://arxiv.org/html/2608.11352#bib.bib6)\]optimizer using a weight decay of1×10−41\\times 10^\{\-4\}\. Gradient clipping with a maximum norm of 1\.0 is applied to stabilize training\.

The learning rate follows a warm\-up and cosine scheduling strategy\. For PHOENIX\-14T, it is warmed up from1×10−61\\times 10^\{\-6\}to2×10−42\\times 10^\{\-4\}over the first 30 epochs, with a minimum learning rate of2×10−62\\times 10^\{\-6\}\. For CSL\-Daily, the learning rate is set to1×10−41\\times 10^\{\-4\}with a minimum learning rate of1×10−61\\times 10^\{\-6\}\. The batch size is set to 32, dropout is set to 0\.1, and label smoothing with a factor of 0\.2 is used during training\.

Both the encoder and decoder consist of 3 Transformer layers by default, and the feed\-forward network dimension is set to 2048\.

Inference\.During inference, we employ autoregressive decoding with beam search to generate target sequences, using only the final decoder for prediction\. For both datasets, the beam width is set to 4 and the length penalty is fixed to 1\.0\.

### 4\.2Experimental Results

#### Comparison with SOTA

Tables[1](https://arxiv.org/html/2608.11352#S4.T1)and[3](https://arxiv.org/html/2608.11352#S4.T3)compare our approach with recent SLT methods on PHOENIX\-14T and CSL\-Daily\. Since existing methods differ in pretraining, visual representations, and model capacity, we include both the broader SOTA comparison and results under the same training and inference setup\. Specifically, we report a non\-iterative baseline withK=0K=0and reproduce IPSLT\[[52](https://arxiv.org/html/2608.11352#bib.bib36)\]using the same visual backbone\. The best IPSLT setting usesK=3K=3with an IDL weight of0\.20\.2\.

For our ODE\-guided decoders, we report the best configuration of each update variant selected by DEV BLEU\-4, including RK2SLT\-M1, RK2SLT\-M2, RK4SLT\-M1, and RK4SLT\-M2\. For the reproduced models, the tables distinguish total stored parameters from active\-path training parameters \(T\-P\) and inference parameters \(I\-P\), and report the selected refinement countKK, final\-decoder depth, realized FLOPs, and batch\-32 inference latency\. On PHOENIX\-14T, RK2SLT\-M1 achieves the strongest BLEU\-4 among our variants and improves BLEU\-4 over the IPSLT baseline\. On CSL\-Daily, the best BLEU\-4 score is achieved by RK2SLT\-M2 using a single refinement iteration and a reduced decoder depth, and RK4SLT\-M2 remains close behind with an even more compact single\-layer decoder\. Compared with recent SLT systems that often rely on larger capacity, pretrained components, or stronger visual representations, our models remain competitive by modifying only the refinement dynamics, supporting our argument that better update rules provide a parameter\-efficient route to stronger translation\.

The test results show a dataset\-dependent effect\. On PHOENIX\-14T, where videos are low\-resolution and the domain is narrow, higher\-order refinement provides more conservative gains, with RK\-2 generalizing best among our variants\. On the larger and more diverse CSL\-Daily dataset, the benefit is clearer: RK2SLT\-M2 achieves the best TEST BLEU\-4, while RK4SLT\-M2 is only0\.090\.09BLEU\-4 lower \(19\.2519\.25vs\.19\.3419\.34\) despite using a single refinement iteration and a single decoder layer\. This indicates that RK\-4 can trade additional per\-step computation for reduced decoder depth and fewer refinement steps, yielding a favorable accuracy–efficiency balance\.

Tables[2](https://arxiv.org/html/2608.11352#S4.T2)and[4](https://arxiv.org/html/2608.11352#S4.T4)show that the BLEU\-4 gains are not obtained by increasing the active parameter count\. On PHOENIX\-14T, RK2SLT\-M2 improves BLEU\-4 over IPSLT by0\.640\.64while reducing T\-P, I\-P, FLOPs, and measured latency by10\.6%10\.6\\%,12\.6%12\.6\\%,14\.1%14\.1\\%, and11\.5%11\.5\\%, respectively\. RK2SLT\-M1 provides a complementary quality\-oriented configuration, improving BLEU\-4 by1\.141\.14at a higher computational cost\. On CSL\-Daily, RK2SLT\-M2 achieves the highest BLEU\-4 of19\.3419\.34with7\.4%7\.4\\%fewer inference\-path parameters than IPSLT, at modest overheads of9\.7%9\.7\\%in FLOPs and6\.3%6\.3\\%in measured latency\. RK4SLT\-M2 remains competitive at19\.2519\.25BLEU\-4 and provides the most compact inference path, using14\.9%14\.9\\%fewer inference\-path parameters than IPSLT\. These results demonstrate that the proposed RK updates provide distinct quality–efficiency operating points without relying on increased model capacity\.

Table 1:Comparison with state\-of\-the\-art methods on the PHOENIX\-14T TEST set\.†: reproduced with our training and inference setup;∼\\sim: approximate size; underlined values denote the best results among iterative methods\.MethodKKDec\. layersParams \(M\)TESTB\-1B\-2B\-3B\-4RGFSLT\-VLP\[[55](https://arxiv.org/html/2608.11352#bib.bib28)\]––∼\\sim60043\.7133\.1826\.1121\.4442\.49SignCL\[[54](https://arxiv.org/html/2608.11352#bib.bib59)\]––∼\\sim60049\.7636\.8529\.9722\.7449\.04Sign2GPT with PGP\[[49](https://arxiv.org/html/2608.11352#bib.bib26)\]––∼\\sim170049\.5435\.9628\.8322\.5248\.90FLa\-LLM\[[12](https://arxiv.org/html/2608.11352#bib.bib30)\]––∼\\sim68046\.2935\.3328\.0323\.0945\.27SignLLM\[[15](https://arxiv.org/html/2608.11352#bib.bib29)\]––∼\\sim700045\.2134\.7828\.0523\.4044\.49Baseline0393\.1643\.7933\.9227\.1222\.5445\.43IPSLT\[[52](https://arxiv.org/html/2608.11352#bib.bib36)\]†3393\.1644\.0933\.6326\.4821\.8246\.35RK2SLT\-M1 \(Ours\)3393\.1644\.3534\.2527\.5322\.9646\.93RK2SLT\-M2 \(Ours\)3184\.7544\.5534\.2127\.2222\.4646\.81RK4SLT\-M1 \(Ours\)3393\.1644\.1934\.1827\.4822\.9147\.39RK4SLT\-M2 \(Ours\)3288\.9544\.3034\.1927\.2022\.6246\.78

Table 2:Parameter counts and measured efficiency on the PHOENIX\-14T TEST set\.T\-P and I\-P denote parameters active during training and inference, respectively\. Parameter counts, FLOPs, and latency exclude the visual encoder\. I\-P additionally excludes the initialization decoder and other training\-only modules\. Per\-sample FP32 latency was measured on a single NVIDIA RTX 4000 Ada Generation GPU and averaged over full batches of 32 after two warm\-up batches\.†Results reproduced using our setup\.

Table 3:Comparison with state\-of\-the\-art methods on the CSL\-Daily TEST set\.†: reproduced with our training and inference setup;∼\\sim: approximate size; underlined values denote the best results among iterative methods\.MethodKKDec\. layersParams \(M\)TESTB\-1B\-2B\-3B\-4RGFSLT\-VLP\[[55](https://arxiv.org/html/2608.11352#bib.bib28)\]––∼\\sim60039\.3724\.9316\.2611\.0036\.44SignCL\[[54](https://arxiv.org/html/2608.11352#bib.bib59)\]––∼\\sim60047\.4732\.5322\.6216\.1648\.92Sign2GPT with PGP\[[49](https://arxiv.org/html/2608.11352#bib.bib26)\]––∼\\sim170041\.7528\.7320\.6015\.4042\.36FLa\-LLM\[[12](https://arxiv.org/html/2608.11352#bib.bib30)\]––∼\\sim68037\.1325\.1218\.3814\.2037\.25SignLLM\[[15](https://arxiv.org/html/2608.11352#bib.bib29)\]––∼\\sim700039\.5528\.1320\.0715\.7539\.91Baseline0382\.9343\.5330\.9422\.4916\.9144\.36IPSLT\[[52](https://arxiv.org/html/2608.11352#bib.bib36)\]†3382\.9346\.2233\.3724\.5218\.4847\.07RK2SLT\-M1 \(Ours\)2382\.9348\.3834\.8825\.4018\.9548\.21RK2SLT\-M2 \(Ours\)1278\.7348\.0234\.8025\.6019\.3448\.69RK4SLT\-M1 \(Ours\)3382\.9346\.6233\.6424\.6818\.5646\.91RK4SLT\-M2 \(Ours\)1174\.5348\.9435\.3325\.7919\.2549\.37

Table 4:Parameter counts and measured efficiency on the CSL\-Daily TEST set\.T\-P and I\-P denote parameters active during training and inference, respectively\. Parameter counts, FLOPs, and latency exclude the visual encoder\. I\-P additionally excludes the initialization decoder and other training\-only modules\. Per\-sample FP32 latency was measured on a single NVIDIA RTX 4000 Ada Generation GPU and averaged over full batches of 32 after two warm\-up batches\.†Results reproduced using our setup\.

#### Ablation Studies

We conduct structured sequential ablations on the DEV sets of PHOENIX\-14T and CSL\-Daily\. Each table isolates one design factor at a time, including coefficients, ODE\-decoder placement, post\-update LayerNorm, iterative distillation loss \(IDL\) weight, refinement iteration count, and decoder depth; after each block, the setting with the best BLEU\-4 is selected and fixed for the following blocks\. Following the IPSLT baseline setting, we report configurations with up to three refinement iterations and three decoder layers, avoiding larger configurations to preserve a controlled parameter\-efficient comparison\. We denote the RK\-2 variants as RK2SLT\-M1 and RK2SLT\-M2, and the RK\-4 variants as RK4SLT\-M1 and RK4SLT\-M2, where M1 and M2 refer to the corresponding update methods\.

##### PHOENIX\-14T\.

The PHOENIX\-14T ablations are shown in Tables[5](https://arxiv.org/html/2608.11352#S4.T5)–[6](https://arxiv.org/html/2608.11352#S4.T6)\. For RK\-2, we first ablate the coefficient formulation, while RK\-4 uses fixed fourth\-order coefficients and therefore starts from the placement and normalization block\.

##### RK2SLT\-M1\.

Table[5](https://arxiv.org/html/2608.11352#S4.T5)selects the learnable RK\-2 combinationα​F1\+\(1−α\)​F2\\alpha F\_\{1\}\+\(1\-\\alpha\)F\_\{2\}; the averaged update12​\(F1\+F2\)\\frac\{1\}\{2\}\(F\_\{1\}\+F\_\{2\}\)yields slightly higher ROUGE but lower BLEU\-4\. The best configuration applies the ODE update to all decoder layers without post\-update LayerNorm, uses IDL weight0\.30\.3, and retains three refinement iterations and three decoder layers, indicating that this variant benefits from full refinement capacity on PHOENIX\-14T\.

##### RK2SLT\-M2\.

Table[5](https://arxiv.org/html/2608.11352#S4.T5)favors the averaged update12​\(F1\+F2\)\\frac\{1\}\{2\}\(F\_\{1\}\+F\_\{2\}\), only marginally ahead of the learnable combination, suggesting Method 2 is less sensitive to coefficient weighting\. It selects refinement\-only placement without LayerNorm, IDL weight0\.30\.3, and three refinement iterations, while the depth ablation prefers a single decoder layer\.

Table 5:Structured sequential ablations for RK2SLT\-M1 and RK2SLT\-M2 on the PHOENIX\-14T DEV set\. BLEU\-4 is the selection criterion; within each block, the selected setting of each variant is marked with✓\\checkmarkand fixed for subsequent blocks\.RK2SLT\-M1RK2SLT\-M2ConfigurationBLEU\-4ROUGEBLEU\-4ROUGECoefficientsF1\+F2F\_\{1\}\+F\_\{2\}23\.1748\.2323\.0247\.6212​\(F1\+F2\)\\frac\{1\}\{2\}\(F\_\{1\}\+F\_\{2\}\)23\.9048\.96✓\\checkmark23\.5447\.93α​F1\+\(1−α\)​F2\\alpha F\_\{1\}\+\(1\-\\alpha\)F\_\{2\}✓\\checkmark24\.0648\.6123\.5247\.92PlacementRefinement layers23\.3047\.79✓\\checkmark23\.9248\.70Refinement layers \+ LN23\.7147\.9923\.8348\.31All layers✓\\checkmark24\.0648\.6123\.5447\.93All layers \+ LN23\.5648\.1823\.4748\.19IDL Weight0\.223\.5848\.4823\.6347\.960\.3✓\\checkmark24\.0648\.61✓\\checkmark23\.9248\.700\.423\.9648\.9823\.5048\.060\.523\.5847\.2723\.3648\.28Refinement IterationsKK123\.5648\.4023\.3348\.06223\.3947\.9322\.9147\.463✓\\checkmark24\.0648\.61✓\\checkmark23\.9248\.70Decoder Depth122\.9047\.22✓\\checkmark23\.9948\.37223\.5547\.6523\.7248\.443✓\\checkmark24\.0648\.6123\.9248\.70
##### RK4SLT\-M1\.

Table[6](https://arxiv.org/html/2608.11352#S4.T6)selects the RK\-4 update on all decoder layers without LayerNorm\. IDL weight0\.20\.2is chosen, and BLEU\-4 favors three refinement iterations and three decoder layers\.

##### RK4SLT\-M2\.

As shown in Table[6](https://arxiv.org/html/2608.11352#S4.T6), the strongest RK4SLT\-M2 configuration applies the RK\-4 update only within the refinement stage without the additional LayerNorm, in line with the broader trend that LayerNorm degrades BLEU\-4\. The best configuration uses IDL weight0\.30\.3and three refinement iterations, while a two\-layer decoder outperforms the three\-layer one\.

Table 6:Structured sequential ablations for RK4SLT\-M1 and RK4SLT\-M2 on the PHOENIX\-14T DEV set\. BLEU\-4 is the selection criterion; within each block, the selected setting of each variant is marked with✓\\checkmarkand fixed for subsequent blocks\. RK\-4 coefficients are fixed\.RK4SLT\-M1RK4SLT\-M2ConfigurationBLEU\-4ROUGEBLEU\-4ROUGEPlacementRefinement layers23\.5347\.67✓\\checkmark23\.7148\.29Refinement layers \+ LN23\.3747\.8823\.4347\.39All layers✓\\checkmark23\.7848\.1423\.6648\.02All layers \+ LN23\.7548\.6323\.4248\.11IDL Weight0\.123\.7448\.5723\.0247\.140\.2✓\\checkmark23\.9048\.0323\.5947\.530\.323\.7848\.14✓\\checkmark23\.7148\.290\.423\.5347\.6023\.1447\.42Refinement IterationsKK123\.8049\.1223\.1648\.54223\.8248\.6523\.2547\.443✓\\checkmark23\.9048\.03✓\\checkmark23\.7148\.29Decoder Depth123\.6248\.5222\.7347\.46223\.6448\.03✓\\checkmark23\.9248\.693✓\\checkmark23\.9048\.0323\.7148\.29
##### CSL\-Daily\.

The CSL\-Daily ablations are reported in Tables[7](https://arxiv.org/html/2608.11352#S4.T7)–[8](https://arxiv.org/html/2608.11352#S4.T8)\. Compared with PHOENIX\-14T, the selected settings more often favor fewer refinement iterations or shallower decoders, indicating that the most effective refinement dynamics are dataset\- and method\-dependent\.

##### RK2SLT\-M1\.

Table[7](https://arxiv.org/html/2608.11352#S4.T7)selects the averaged RK\-2 update, refinement\-only placement with LayerNorm, and a small IDL weight of0\.050\.05, consistent with CSL\-Daily favoring lighter intermediate supervision\. Two refinement iterations outperform one and three, and three decoder layers are selected, though the depth trade\-off is relatively flat\.

##### RK2SLT\-M2\.

Table[7](https://arxiv.org/html/2608.11352#S4.T7)selects the averaged RK\-2 update over the unscaled and learnable alternatives, refinement\-only placement without LayerNorm, IDL weight0\.10\.1, a single refinement iteration, and two decoder layers\. This compact configuration also gives the strongest TEST BLEU\-4 among our variants on CSL\-Daily\.

Table 7:Structured sequential ablations for RK2SLT\-M1 and RK2SLT\-M2 on the CSL\-Daily DEV set\. BLEU\-4 is the selection criterion; within each block, the selected setting of each variant is marked with✓\\checkmarkand fixed for subsequent blocks\.RK2SLT\-M1RK2SLT\-M2ConfigurationBLEU\-4ROUGEBLEU\-4ROUGECoefficientsF1\+F2F\_\{1\}\+F\_\{2\}18\.4747\.6117\.1444\.9412​\(F1\+F2\)\\frac\{1\}\{2\}\(F\_\{1\}\+F\_\{2\}\)✓\\checkmark18\.6747\.50✓\\checkmark18\.1946\.50α​F1\+\(1−α\)​F2\\alpha F\_\{1\}\+\(1\-\\alpha\)F\_\{2\}18\.5946\.9117\.6245\.94PlacementRefinement layers17\.9746\.46✓\\checkmark18\.1946\.50Refinement layers \+ LN✓\\checkmark18\.6747\.5017\.7646\.06All layers18\.1146\.9618\.1446\.33All layers \+ LN18\.6647\.2917\.7946\.01IDL Weight0\.05✓\\checkmark18\.8447\.8817\.8446\.080\.118\.6747\.29✓\\checkmark18\.1946\.500\.218\.6746\.9318\.0046\.140\.318\.6747\.2917\.8146\.33Refinement IterationsKK118\.8647\.84✓\\checkmark18\.4947\.582✓\\checkmark19\.1748\.1118\.0246\.73318\.8447\.8818\.1946\.50Decoder Depth118\.9048\.4318\.7247\.59219\.0748\.03✓\\checkmark18\.9647\.783✓\\checkmark19\.1748\.1118\.4947\.58
##### RK4SLT\-M1\.

Table[8](https://arxiv.org/html/2608.11352#S4.T8)selects the RK\-4 update in the refinement decoder layers with LayerNorm\. IDL weight0\.20\.2is chosen, and BLEU\-4 favors three refinement iterations and three decoder layers\. RK4SLT\-M1 improves longer n\-gram consistency through deeper refinement\.

##### RK4SLT\-M2\.

Table[8](https://arxiv.org/html/2608.11352#S4.T8)shows the strongest efficiency\-oriented trend: refinement\-only placement with LayerNorm is best, while all\-layer LayerNorm degrades performance sharply\. With IDL weight0\.30\.3, both the iteration and depth blocks select the single\-step, single\-layer setting, so RK4SLT\-M2 exploits the stronger RK\-4 update in a compact configuration\.

Table 8:Structured sequential ablations for RK4SLT\-M1 and RK4SLT\-M2 on the CSL\-Daily DEV set\. BLEU\-4 is the selection criterion; within each block, the selected setting of each variant is marked with✓\\checkmarkand fixed for subsequent blocks\. RK\-4 coefficients are fixed\.RK4SLT\-M1RK4SLT\-M2ConfigurationBLEU\-4ROUGEBLEU\-4ROUGEPlacementRefinement layers17\.7946\.3017\.9845\.87Refinement layers \+ LN✓\\checkmark18\.6846\.85✓\\checkmark18\.0346\.05All layers17\.9546\.1317\.9545\.95All layers \+ LN18\.2646\.7016\.7343\.83IDL Weight0\.118\.4847\.0317\.9146\.550\.2✓\\checkmark18\.6846\.8518\.0346\.050\.318\.3346\.69✓\\checkmark18\.0445\.910\.418\.0346\.3917\.6345\.99Refinement IterationsKK118\.5848\.10✓\\checkmark18\.5147\.34218\.3846\.3517\.9345\.973✓\\checkmark18\.6846\.8518\.0445\.91Decoder Depth118\.2147\.57✓\\checkmark18\.7648\.33218\.1846\.9418\.3448\.113✓\\checkmark18\.6846\.8518\.5147\.34
##### Overall observations\.

Across both datasets, the optimal ODE\-decoder design is method\- and dataset\-dependent\. For RK\-2, coefficient scaling matters, with averaged or learnable combinations outperforming the unscaled update\. ODE\-update placement and post\-update LayerNorm are not universally beneficial, and IDL requires moderate weighting, as stronger supervision can reduce final BLEU\-4\. Finally, PHOENIX\-14T generally favors more refinement iterations, whereas CSL\-Daily admits compact configurations with fewer iterations and shallower decoders, supporting the accuracy–efficiency trade\-off of ODE\-guided refinement\.

## 5Conclusion

In this work, we introduced ODE\-guided Transformer decoders for iterative sign language translation, replacing standard residual updates with Runge–Kutta\-inspired formulations that improve decoder update dynamics without adding model parameters\. Experiments on PHOENIX\-14T and CSL\-Daily show that the proposed updates improve TEST BLEU\-4 over the matched IPSLT baseline, while the ablation studies identify dataset\-specific choices for coefficient weighting, placement, normalization, IDL weighting, and refinement depth\. On CSL\-Daily, the fourth\-order RK4SLT\-M2 is especially notable: it stays within0\.090\.09TEST BLEU\-4 of the best variant while using a single refinement iteration and a single decoder layer, so its extra per\-step function evaluations effectively substitute for decoder depth and repeated refinement\. Since RK\-2 and RK\-4 involve multiple function evaluations, we distinguish parameter efficiency from computational efficiency and report iteration counts and decoder depth to clarify the accuracy–efficiency trade\-off\. These results suggest that refining how representations are updated is a promising direction, complementary to scaling pretrained models for SLT\.

## Acknowledgments

This work is supported by the Scientific and Technological Research Council of Türkiye \(TÜBİTAK\) under the 1001 Scientific and Technological Research Projects Funding Program \(Project No\. 124E618\)\. We acknowledge the EuroHPC Joint Undertaking for awarding us access to Vega at IZUM, Slovenia, through Development Access allocation 2025D08\-090\.

## References

- \[1\]\(2018\)Image super\-resolution via progressive cascading residual network\.In2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops \(CVPRW\),Vol\.,pp\. 904–9048\.External Links:[Document](https://dx.doi.org/10.1109/CVPRW.2018.00123)Cited by:[§2\.3](https://arxiv.org/html/2608.11352#S2.SS3.p1.1)\.
- \[2\]Y\. Alaluf, O\. Patashnik, and D\. Cohen\-Or\(2021\)ReStyle: a residual\-based stylegan encoder via iterative refinement\.In2021 IEEE/CVF International Conference on Computer Vision \(ICCV\),Vol\.,pp\. 6711–6720\.External Links:[Document](https://dx.doi.org/10.1109/ICCV48922.2021.00664)Cited by:[§2\.3](https://arxiv.org/html/2608.11352#S2.SS3.p1.1)\.
- \[3\]S\. Albanie, G\. Varol, L\. Momeni, H\. Bull, T\. Afouras, H\. Chowdhury, N\. Fox, B\. Woll, R\. Cooper, A\. McParland, and A\. Zisserman\(2021\)BBC\-oxford british sign language dataset\.Note:Accessed 8 July 2026External Links:2111\.03635,[Link](https://arxiv.org/abs/2111.03635)Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p2.1)\.
- \[4\]S\. Bae, A\. Fisch, H\. Harutyunyan, Z\. Ji, S\. Kim, and T\. Schuster\(2025\)Relaxed recursive transformers: effective parameter sharing with layer\-wise lora\.InInternational Conference on Learning Representations \(ICLR\),External Links:[Link](https://proceedings.iclr.cc/paper_files/paper/2025/hash/54d6a55225cebbdc16fbb0e45c5bdf2b-Abstract-Conference.html)Cited by:[§2\.3](https://arxiv.org/html/2608.11352#S2.SS3.p2.1)\.
- \[5\]S\. Bae, Y\. Kim, R\. Bayat, S\. Kim, J\. Ha, T\. Schuster, A\. Fisch, H\. Harutyunyan, Z\. Ji, A\. C\. Courville, and S\. Yun\(2025\)Mixture\-of\-recursions: learning dynamic recursive depths for adaptive token\-level computation\.InAdvances in Neural Information Processing Systems,Vol\.38\.External Links:[Link](https://proceedings.neurips.cc/paper_files/paper/2025/hash/8b08bbf8b420faa6eeb4020720582ec7-Abstract-Conference.html)Cited by:[§2\.3](https://arxiv.org/html/2608.11352#S2.SS3.p2.1)\.
- \[6\]S\. Bai, J\. Z\. Kolter, and V\. Koltun\(2019\)Deep equilibrium models\.InAdvances in Neural Information Processing Systems \(NeurIPS\),Cited by:[§2\.2](https://arxiv.org/html/2608.11352#S2.SS2.p1.1)\.
- \[7\]N\. C\. Camgoz, S\. Hadfield, O\. Koller, H\. Ney, and R\. Bowden\(2018\)Neural sign language translation\.In2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition,Vol\.,pp\. 7784–7793\.External Links:[Document](https://dx.doi.org/10.1109/CVPR.2018.00812)Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p2.1),[§4\.1](https://arxiv.org/html/2608.11352#S4.SS1.p1.1)\.
- \[8\]N\. C\. Camgoz, O\. Koller, S\. Hadfield, and R\. Bowden\(2020\)Sign language transformers: joint end\-to\-end sign language recognition and translation\.InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition \(CVPR\),pp\. 10023–10033\.Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p2.1)\.
- \[9\]R\. T\. Q\. Chen, Y\. Rubanova, J\. Bettencourt, and D\. Duvenaud\(2018\)Neural ordinary differential equations\.InProceedings of the 32nd International Conference on Neural Information Processing Systems,NIPS’18,Red Hook, NY, USA,pp\. 6572–6583\.Cited by:[§2\.2](https://arxiv.org/html/2608.11352#S2.SS2.p1.1)\.
- \[10\]Y\. Chen, F\. Wei, X\. Sun, Z\. Wu, and S\. Lin\(2022\)A simple multi\-modality transfer learning baseline for sign language translation\.InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition \(CVPR\),pp\. 5120–5130\.Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p2.1),[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p3.1)\.
- \[11\]Y\. Chen, R\. Zuo, F\. Wei, Y\. Wu, S\. Liu, and B\. Mak\(2022\)Two\-stream network for sign language recognition and translation\.InProceedings of the 36th International Conference on Neural Information Processing Systems,NIPS ’22,Red Hook, NY, USA\.External Links:ISBN 9781713871088Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p2.1)\.
- \[12\]Z\. Chen, B\. Zhou, J\. Li, J\. Wan, Z\. Lei, N\. Jiang, Q\. Lu, and G\. Zhao\(2024\)Factorized learning assisted with large language model for gloss\-free sign language translation\.InProceedings of the 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation \(LREC\-COLING 2024\),Torino, Italia,pp\. 7071–7081\.External Links:[Link](https://aclanthology.org/2024.lrec-main.620/)Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p4.1),[Table 1](https://arxiv.org/html/2608.11352#S4.T1.6.1.1.1.1.1.1.6.1),[Table 3](https://arxiv.org/html/2608.11352#S4.T3.6.1.1.1.1.1.1.6.1)\.
- \[13\]M\. Dehghani, S\. Gouws, O\. Vinyals, J\. Uszkoreit, and L\. Kaiser\(2019\)Universal transformers\.InInternational Conference on Learning Representations \(ICLR\),External Links:[Link](https://openreview.net/forum?id=HyzdRiR9Y7)Cited by:[§2\.3](https://arxiv.org/html/2608.11352#S2.SS3.p2.1)\.
- \[14\]M\. Elbayad, J\. Gu, E\. Grave, and M\. Auli\(2020\)Depth\-adaptive transformer\.InInternational Conference on Learning Representations \(ICLR\),External Links:[Link](https://openreview.net/forum?id=1KLUy-X5Ayy)Cited by:[§2\.3](https://arxiv.org/html/2608.11352#S2.SS3.p2.1)\.
- \[15\]J\. Gong, L\. G\. Foo, Y\. He, H\. Rahmani, and J\. Liu\(2024\)LLMs are good sign language translators\.2024 IEEE/CVF Conference on Computer Vision and Pattern Recognition \(CVPR\),pp\. 18362–18372\.Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p4.1),[Table 1](https://arxiv.org/html/2608.11352#S4.T1.6.1.1.1.1.1.1.7.1),[Table 3](https://arxiv.org/html/2608.11352#S4.T3.6.1.1.1.1.1.1.7.1)\.
- \[16\]K\. Gregor, I\. Danihelka, A\. Graves, D\. J\. Rezende, and D\. Wierstra\(2015\)DRAW: a recurrent neural network for image generation\.InProceedings of the 32nd International Conference on Machine Learning,Proceedings of Machine Learning Research, Vol\.37,pp\. 1462–1471\.External Links:[Link](https://proceedings.mlr.press/v37/gregor15.html)Cited by:[§2\.3](https://arxiv.org/html/2608.11352#S2.SS3.p1.1)\.
- \[17\]S\. Gueuwou, X\. Du, G\. Shakhnarovich, and K\. Livescu\(2025\)SignMusketeers: an efficient multi\-stream approach for sign language translation at scale\.InFindings of the Association for Computational Linguistics: ACL 2025,W\. Che, J\. Nabende, E\. Shutova, and M\. T\. Pilehvar \(Eds\.\),Vienna, Austria,pp\. 22506–22521\.External Links:[Document](https://dx.doi.org/10.18653/v1/2025.findings-acl.1157),ISBN 979\-8\-89176\-256\-5Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p4.1)\.
- \[18\]J\. Guo, P\. Li, and T\. Cohn\(2025\)Bridging sign and spoken languages: pseudo gloss generation for sign language translation\.InThe Thirty\-ninth Annual Conference on Neural Information Processing Systems,Note:Accessed 8 July 2026External Links:[Link](https://openreview.net/forum?id=p6Huickfj7)Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p4.1)\.
- \[19\]L\. Guo, W\. Xue, Q\. Guo, B\. Liu, K\. Zhang, T\. Yuan, and S\. Chen\(2023\)Distilling cross\-temporal contexts for continuous sign language recognition\.In2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition \(CVPR\),Vol\.,pp\. 10771–10780\.External Links:[Document](https://dx.doi.org/10.1109/CVPR52729.2023.01037)Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p1.1)\.
- \[20\]L\. Hu, L\. Gao, Z\. Liu, and W\. Feng\(2023\)Continuous sign language recognition with correlation network\.In2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition \(CVPR\),Vol\.,pp\. 2529–2539\.External Links:[Document](https://dx.doi.org/10.1109/CVPR52729.2023.00249)Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p1.1)\.
- \[21\]L\. Hu, L\. Gao, Z\. Liu, and W\. Feng\(2023\)Self\-emphasizing network for continuous sign language recognition\.InProceedings of the AAAI Conference on Artificial Intelligence,Vol\.37,pp\. 854–862\.External Links:[Document](https://dx.doi.org/10.1609/aaai.v37i1.25164)Cited by:[§3\.1](https://arxiv.org/html/2608.11352#S3.SS1.p1.1)\.
- \[22\]E\. J\. Hwang, S\. Cho, J\. Lee, and J\. C\. Park\(2025\)An efficient gloss\-free sign language translation using spatial configurations and motion dynamics with LLMs\.InProceedings of the 2025 Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics: Human Language Technologies \(Volume 1: Long Papers\),L\. Chiruzzo, A\. Ritter, and L\. Wang \(Eds\.\),Albuquerque, New Mexico,pp\. 3901–3920\.External Links:[Document](https://dx.doi.org/10.18653/v1/2025.naacl-long.197),ISBN 979\-8\-89176\-189\-6Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p4.1)\.
- \[23\]Y\. Jang, L\. Momeni, Z\. Jiang, J\. S\. Chung, G\. Varol, and A\. Zisserman\(2025\)Lost in translation, found in embeddings: sign language translation and alignment\.ArXivabs/2512\.08040\.Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p4.1)\.
- \[24\]T\. Kızıltepe, S\. M\. Taşyürek, and H\. Y\. Keles\(2025\)Iterative latent refinement for robust non\-autoregressive sign language production\.InProceedings of the IEEE/CVF International Conference on Computer Vision \(ICCV\) Workshops,pp\. 4942–4952\.Cited by:[§2\.3](https://arxiv.org/html/2608.11352#S2.SS3.p3.1)\.
- \[25\]B\. Li, Q\. Du, T\. Zhou, Y\. Jing, S\. Zhou, X\. Zeng, T\. Xiao, J\. Zhu, X\. Liu, and M\. Zhang\(2022\)ODE transformer: an ordinary differential equation\-inspired model for sequence generation\.InProceedings of the 60th Annual Meeting of the Association for Computational Linguistics \(Volume 1: Long Papers\),S\. Muresan, P\. Nakov, and A\. Villavicencio \(Eds\.\),Dublin, Ireland,pp\. 8335–8351\.External Links:[Document](https://dx.doi.org/10.18653/v1/2022.acl-long.571)Cited by:[§1](https://arxiv.org/html/2608.11352#S1.p3.1),[§2\.2](https://arxiv.org/html/2608.11352#S2.SS2.p2.1),[§2\.2](https://arxiv.org/html/2608.11352#S2.SS2.p3.1),[§3\.4](https://arxiv.org/html/2608.11352#S3.SS4.SSS0.Px2.p1.1)\.
- \[26\]Y\. Li, X\. Chen, H\. Li, X\. Pu, P\. Jin, and Y\. Ren\(2025\)VSNet: focusing on the linguistic characteristics of sign language\.In2025 IEEE/CVF Conference on Computer Vision and Pattern Recognition \(CVPR\),Vol\.,pp\. 24320–24330\.External Links:[Document](https://dx.doi.org/10.1109/CVPR52734.2025.02265)Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p1.1)\.
- \[27\]Z\. Li, W\. Zhou, W\. Zhao, K\. Wu, H\. Hu, and H\. Li\(2025\)Uni\-sign: toward unified sign language understanding at scale\.InInternational Conference on Learning Representations \(ICLR\),External Links:[Link](https://proceedings.iclr.cc/paper_files/paper/2025/hash/260a14acce2a89dad36adc8eefe7c59e-Abstract-Conference.html)Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p1.1)\.
- \[28\]C\. Lin\(2004\)ROUGE: a package for automatic evaluation of summaries\.InText Summarization Branches Out,Barcelona, Spain,pp\. 74–81\.Note:Accessed 8 July 2026External Links:[Link](https://aclanthology.org/W04-1013/)Cited by:[§4\.1](https://arxiv.org/html/2608.11352#S4.SS1.p2.1)\.
- \[29\]H\. Ling, J\. Gao, A\. Kar, W\. Chen, and S\. Fidler\(2019\)Fast interactive object annotation with curve\-gcn\.InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition \(CVPR\),pp\. 5257–5266\.Cited by:[§2\.3](https://arxiv.org/html/2608.11352#S2.SS3.p1.1)\.
- \[30\]Z\. Liu, J\. H\. Liew, X\. Chen, and J\. Feng\(2021\)DANCE : a deep attentive contour model for efficient instance segmentation\.In2021 IEEE Winter Conference on Applications of Computer Vision \(WACV\),Vol\.,pp\. 345–354\.External Links:[Document](https://dx.doi.org/10.1109/WACV48630.2021.00039)Cited by:[§2\.3](https://arxiv.org/html/2608.11352#S2.SS3.p1.1)\.
- \[31\]I\. Loshchilov and F\. Hutter\(2019\)Decoupled weight decay regularization\.InInternational Conference on Learning Representations \(ICLR\),External Links:[Link](https://openreview.net/forum?id=Bkg6RiCqY7)Cited by:[§4\.1](https://arxiv.org/html/2608.11352#S4.SS1.p3.1)\.
- \[32\]A\. Madaan, N\. Tandon, P\. Gupta, S\. Hallinan, L\. Gao, S\. Wiegreffe, U\. Alon, N\. Dziri, S\. Prabhumoye, Y\. Yang, S\. Gupta, B\. P\. Majumder, K\. Hermann, S\. Welleck, A\. Yazdanbakhsh, and P\. Clark\(2023\)Self\-refine: iterative refinement with self\-feedback\.InThirty\-seventh Conference on Neural Information Processing Systems,Note:Accessed 8 July 2026External Links:[Link](https://openreview.net/forum?id=S37hOerQLB)Cited by:[§2\.3](https://arxiv.org/html/2608.11352#S2.SS3.p1.1)\.
- \[33\]O\. Mercanoglu Sincan and R\. Bowden\(2025\)Contrastive pretraining with dual visual encoders for gloss\-free sign language translation\.InAdjunct Proceedings of the 25th ACM International Conference on Intelligent Virtual Agents,IVA Adjunct ’25,New York, NY, USA\.External Links:ISBN 9798400719967,[Document](https://dx.doi.org/10.1145/3742886.3756703)Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p3.1)\.
- \[34\]Y\. Min, A\. Hao, X\. Chai, and X\. Chen\(2021\)Visual alignment constraint for continuous sign language recognition\.InProceedings of the IEEE/CVF International Conference on Computer Vision \(ICCV\),pp\. 11542–11551\.Cited by:[§3\.1](https://arxiv.org/html/2608.11352#S3.SS1.p1.1)\.
- \[35\]K\. Papineni, S\. Roukos, T\. Ward, and W\. Zhu\(2002\)Bleu: a method for automatic evaluation of machine translation\.InProceedings of the 40th Annual Meeting of the Association for Computational Linguistics,P\. Isabelle, E\. Charniak, and D\. Lin \(Eds\.\),Philadelphia, Pennsylvania, USA,pp\. 311–318\.External Links:[Document](https://dx.doi.org/10.3115/1073083.1073135)Cited by:[§4\.1](https://arxiv.org/html/2608.11352#S4.SS1.p2.1)\.
- \[36\]A\. Paszke, S\. Gross, F\. Massa, A\. Lerer, J\. Bradbury, G\. Chanan, T\. Killeen, Z\. Lin, N\. Gimelshein, L\. Antiga, A\. Desmaison, A\. Köpf, E\. Yang, Z\. DeVito, M\. Raison, A\. Tejani, S\. Chilamkurthy, B\. Steiner, L\. Fang, J\. Bai, and S\. Chintala\(2019\)PyTorch: an imperative style, high\-performance deep learning library\.InAdvances in Neural Information Processing Systems,Vol\.32\.External Links:[Link](https://proceedings.neurips.cc/paper/2019/hash/bdbca288fee7f92f2bfa9f7012727740-Abstract.html)Cited by:[§4\.1](https://arxiv.org/html/2608.11352#S4.SS1.p3.1)\.
- \[37\]S\. Peng, W\. Jiang, H\. Pi, X\. Li, H\. Bao, and X\. Zhou\(2020\)Deep snake for real\-time instance segmentation\.InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition \(CVPR\),pp\. 8533–8542\.Cited by:[§2\.3](https://arxiv.org/html/2608.11352#S2.SS3.p1.1)\.
- \[38\]M\. Post\(2018\)A call for clarity in reporting BLEU scores\.InProceedings of the Third Conference on Machine Translation: Research Papers,Brussels, Belgium,pp\. 186–191\.External Links:[Document](https://dx.doi.org/10.18653/v1/W18-6319)Cited by:[§4\.1](https://arxiv.org/html/2608.11352#S4.SS1.p2.1)\.
- \[39\]D\. Ren, W\. Zuo, Q\. Hu, P\. Zhu, and D\. Meng\(2019\)Progressive image deraining networks: a better and simpler baseline\.InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition \(CVPR\),pp\. 3937–3946\.Cited by:[§2\.3](https://arxiv.org/html/2608.11352#S2.SS3.p1.1)\.
- \[40\]C\. Saharia, J\. Ho, W\. Chan, T\. Salimans, D\. J\. Fleet, and M\. Norouzi\(2023\)Image super\-resolution via iterative refinement\.IEEE Transactions on Pattern Analysis and Machine Intelligence45\(4\),pp\. 4713–4726\.External Links:[Document](https://dx.doi.org/10.1109/TPAMI.2022.3204461)Cited by:[§2\.3](https://arxiv.org/html/2608.11352#S2.SS3.p1.1)\.
- \[41\]Z\. Shen, Z\. Liu, and E\. Xing\(2022\)Sliced recursive transformer\.InComputer Vision – ECCV 2022: 17th European Conference, Tel Aviv, Israel, October 23–27, 2022, Proceedings, Part XXIV,Berlin, Heidelberg,pp\. 727–744\.External Links:ISBN 978\-3\-031\-20052\-6,[Document](https://dx.doi.org/10.1007/978-3-031-20053-3%5F42)Cited by:[§2\.3](https://arxiv.org/html/2608.11352#S2.SS3.p2.1)\.
- \[42\]B\. Shi, D\. Brentari, G\. Shakhnarovich, and K\. Livescu\(2022\)Open\-domain sign language translation learned from online video\.InProceedings of the 2022 Conference on Empirical Methods in Natural Language Processing,Abu Dhabi, United Arab Emirates,pp\. 6365–6379\.External Links:[Document](https://dx.doi.org/10.18653/v1/2022.emnlp-main.427)Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p2.1)\.
- \[43\]O\. M\. Sincan and H\. Y\. Keles\(2020\)AUTSL: a large scale multi\-modal turkish sign language dataset and baseline methods\.IEEE Access8,pp\. 181340–181355\.External Links:ISSN 2169\-3536,[Document](https://dx.doi.org/10.1109/access.2020.3028072)Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p1.1)\.
- \[44\]S\. Tan, T\. Miyazaki, N\. Khan, and K\. Nakadai\(2025\)Improvement in sign language translation using text CTC alignment\.InProceedings of the 31st International Conference on Computational Linguistics,O\. Rambow, L\. Wanner, M\. Apidianaki, H\. Al\-Khalifa, B\. D\. Eugenio, and S\. Schockaert \(Eds\.\),Abu Dhabi, UAE,pp\. 3255–3266\.Note:Accessed 8 July 2026External Links:[Link](https://aclanthology.org/2025.coling-main.219/)Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p2.1)\.
- \[45\]G\. Tanzer and B\. Zhang\(2024\)YouTube\-sl\-25: a large\-scale, open\-domain multilingual sign language parallel corpus\.Note:Accessed 8 July 2026External Links:2407\.11144,[Link](https://arxiv.org/abs/2407.11144)Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p2.1)\.
- \[46\]A\. Tong, T\. Nguyen\-Tang, D\. Lee, D\. Nguyen, T\. Tran, D\. L\. W\. Hall, C\. Kang, and J\. Choi\(2025\)Neural ODE transformers: analyzing internal dynamics and adaptive fine\-tuning\.InThe Thirteenth International Conference on Learning Representations,Note:Accessed 8 July 2026External Links:[Link](https://openreview.net/forum?id=XnDyddPcBT)Cited by:[§2\.2](https://arxiv.org/html/2608.11352#S2.SS2.p2.1)\.
- \[47\]D\. Uthus, G\. Tanzer, and M\. Georg\(2023\)YouTube\-asl: a large\-scale, open\-domain american sign language\-english parallel corpus\.InAdvances in Neural Information Processing Systems,Vol\.36,pp\. 29029–29047\.External Links:[Link](https://proceedings.neurips.cc/paper_files/paper/2023/hash/5c61452daca5f0c260e683b317d13a3f-Abstract-Datasets_and_Benchmarks.html)Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p2.1)\.
- \[48\]F\. Wei and Y\. Chen\(2023\)Improving continuous sign language recognition with cross\-lingual signs\.InProceedings of the IEEE/CVF International Conference on Computer Vision \(ICCV\),pp\. 23612–23621\.Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p1.1)\.
- \[49\]R\. Wong, N\. C\. Camgoz, and R\. Bowden\(2024\)Sign2GPT: leveraging large language models for gloss\-free sign language translation\.InThe Twelfth International Conference on Learning Representations,Note:Accessed 8 July 2026External Links:[Link](https://openreview.net/forum?id=LqaEEs3UxU)Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p3.1),[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p4.1),[Table 1](https://arxiv.org/html/2608.11352#S4.T1.6.1.1.1.1.1.1.5.1),[Table 3](https://arxiv.org/html/2608.11352#S4.T3.6.1.1.1.1.1.1.5.1)\.
- \[50\]W\. Wu, T\. Yuan, Y\. Li, D\. Wang, and X\. Fu\(2026\)Mouthing\-enhanced multimodal hierarchical contrastive learning for gloss\-free sign language translation\.In2026 IEEE International Conference on Acoustics, Speech and Signal Processing \(ICASSP\),pp\. 8787–8791\.External Links:[Document](https://dx.doi.org/10.1109/ICASSP55912.2026.11463378)Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p4.1)\.
- \[51\]R\. Xu, Y\. Gao, L\. Wang, J\. Li, W\. Chen, Q\. Guo, M\. Yang, and S\. Zhang\(2026\)Looping back to move forward: recursive transformers for efficient and flexible large multimodal models\.Note:Accessed 8 July 2026External Links:2602\.09080,[Link](https://arxiv.org/abs/2602.09080)Cited by:[§2\.3](https://arxiv.org/html/2608.11352#S2.SS3.p2.1)\.
- \[52\]H\. Yao, W\. Zhou, H\. Feng, H\. Hu, H\. Zhou, and H\. Li\(2023\)Sign language translation with iterative prototype\.InProceedings of the IEEE/CVF International Conference on Computer Vision \(ICCV\),pp\. 15592–15601\.Cited by:[§2\.3](https://arxiv.org/html/2608.11352#S2.SS3.p3.1),[§3](https://arxiv.org/html/2608.11352#S3.p1.1),[§4\.2](https://arxiv.org/html/2608.11352#S4.SS2.SSSx1.p1.1),[Table 1](https://arxiv.org/html/2608.11352#S4.T1.6.1.1.1.1.1.1.9.1),[Table 2](https://arxiv.org/html/2608.11352#S4.T2.5.1.1.1.1.1.3.1),[Table 3](https://arxiv.org/html/2608.11352#S4.T3.6.1.1.1.1.1.1.9.1),[Table 4](https://arxiv.org/html/2608.11352#S4.T4.5.1.1.1.1.1.3.1)\.
- \[53\]J\. Ye, W\. Jiao, X\. Wang, Z\. Tu, and H\. Xiong\(2023\)Cross\-modality data augmentation for end\-to\-end sign language translation\.InFindings of the Association for Computational Linguistics: EMNLP 2023,H\. Bouamor, J\. Pino, and K\. Bali \(Eds\.\),Singapore,pp\. 13558–13571\.External Links:[Document](https://dx.doi.org/10.18653/v1/2023.findings-emnlp.904)Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p2.1)\.
- \[54\]J\. Ye, X\. Wang, W\. Jiao, J\. Liang, and H\. Xiong\(2024\)Improving gloss\-free sign language translation by reducing representation density\.InAdvances in Neural Information Processing Systems,Vol\.37\.External Links:[Document](https://dx.doi.org/10.52202/079017-3411),[Link](https://proceedings.neurips.cc/paper_files/paper/2024/hash/c225136cfe52a8fd66658bbcf9d894ab-Abstract-Conference.html)Cited by:[Table 1](https://arxiv.org/html/2608.11352#S4.T1.6.1.1.1.1.1.1.4.1),[Table 3](https://arxiv.org/html/2608.11352#S4.T3.6.1.1.1.1.1.1.4.1)\.
- \[55\]A\. Yin, T\. Zhong, L\. Tang, W\. Jin, T\. Jin, and Z\. Zhao\(2023\)Gloss attention for gloss\-free sign language translation\.InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition,pp\. 2551–2562\.Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p3.1),[§3\.3](https://arxiv.org/html/2608.11352#S3.SS3.p3.1),[Table 1](https://arxiv.org/html/2608.11352#S4.T1.6.1.1.1.1.1.1.3.1),[Table 3](https://arxiv.org/html/2608.11352#S4.T3.6.1.1.1.1.1.1.3.1)\.
- \[56\]B\. Zhang, M\. Müller, and R\. Sennrich\(2023\)SLTUNET: a simple unified model for sign language translation\.InThe Eleventh International Conference on Learning Representations,Note:Accessed 8 July 2026External Links:[Link](https://openreview.net/forum?id=EBS4C77p_5S)Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p2.1)\.
- \[57\]T\. Zhang, S\. Wei, and S\. Ji\(2022\)E2EC: an end\-to\-end contour\-based method for high\-quality high\-speed instance segmentation\.InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition \(CVPR\),pp\. 4443–4452\.Cited by:[§2\.3](https://arxiv.org/html/2608.11352#S2.SS3.p1.1)\.
- \[58\]Y\. D\. Zhong, T\. Zhang, A\. Chakraborty, and B\. Dey\(2022\)A neural ODE interpretation of transformer layers\.InThe Symbiosis of Deep Learning and Differential Equations II,Note:Accessed 8 July 2026External Links:[Link](https://openreview.net/forum?id=nA9hvYMQCy)Cited by:[§1](https://arxiv.org/html/2608.11352#S1.p3.1),[§2\.2](https://arxiv.org/html/2608.11352#S2.SS2.p2.1)\.
- \[59\]B\. Zhou, Z\. Chen, A\. Clapés, J\. Wan, Y\. Liang, S\. Escalera, Z\. Lei, and D\. Zhang\(2023\)Gloss\-free sign language translation: improving from visual\-language pretraining\.InProceedings of the IEEE/CVF International Conference on Computer Vision \(ICCV\),pp\. 20871–20881\.Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p3.1)\.
- \[60\]H\. Zhou, W\. Zhou, W\. Qi, J\. Pu, and H\. Li\(2021\)Improving sign language translation with monolingual data by sign back\-translation\.InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition \(CVPR\),pp\. 1316–1325\.Cited by:[§4\.1](https://arxiv.org/html/2608.11352#S4.SS1.p1.1)\.
- \[61\]R\. Zuo, F\. Wei, and B\. Mak\(2023\)Natural language\-assisted sign language recognition\.InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition \(CVPR\),pp\. 14890–14900\.Cited by:[§2\.1](https://arxiv.org/html/2608.11352#S2.SS1.p1.1)\.

Similar Articles

Toward Real-Time Sentence-Level Sign Language Translation

arXiv cs.CL

This paper presents a sentence-level sign language translation system fine-tuned with QLoRA on a subset of How2Sign, achieving BLEU 15.9. Its main contribution is a hardware-aware streaming pipeline using a Raspberry Pi 4B client and a CPU/GPU backend, reducing mean latency by 27.71%.

Direct Translation between Sign Languages

arXiv cs.CL

This paper introduces a direct sign-to-sign translation model that bypasses intermediate text by using back-translation to create synthetic parallel sign language data, achieving significant improvements in speed and accuracy over cascade methods for ASL, CSL, and DGS.

Training, Reading, and Editing Legible Transformers

arXiv cs.LG

This paper introduces methods to train transformers with legible-by-construction operators using a crispness penalty that avoids collapse via a per-channel variance floor, achieving high legibility and quality parity with conventional baselines.