EMGBlend: Heterogeneity-Aware Self-Supervised Pretraining for Gesture and Force Decoding
Summary
EMGBlend introduces a self-supervised framework for pretraining on heterogeneous EMG datasets, addressing differences in electrode layouts, frequency support, and data source imbalances to improve gesture recognition and force decoding tasks.
View Cached Full Text
Cached at: 09/23/26, 09:32 AM
# Heterogeneity-Aware Self-Supervised Pretrainingfor Gesture and Force Decoding
Source: [https://arxiv.org/html/2609.25582](https://arxiv.org/html/2609.25582)
## EMGBlend: Heterogeneity\-Aware Self\-Supervised Pretraining for Gesture and Force Decoding
###### Abstract
Public surface electromyography \(EMG\) datasets vary widely in electrode layout, channel count, frequency support, and size\. Simply mixing them for pretraining can misalign channel semantics, introduce spectral targets that some devices cannot observe, and let large or high\-channel\-count datasets dominate learning\. We introduce EMGBlend, a self\-supervised framework designed around these differences\. It combines shared channel patches with geometry\-aware attention, restricts spectral targets to each recording’s supported frequency band, and balances exposure across data sources\. We pretrain a 109M\-parameter model on 11 public EMG sources and evaluate it on gesture recognition, continuous\-force regression, and contact classification\. EMGBlend consistently outperforms matched random initialization and waveform reconstruction controls\. Fixed\-budget source controls show that multi\-source pretraining improves gesture recognition and remains competitive for force decoding\. Ablations confirm that geometry, band\-aware targets, and source balancing each contribute to transfer, although cross\-person NinaPro force estimation remains difficult\. Overall, EMGBlend shows how heterogeneous EMG datasets can be combined through explicit mechanism design rather than simple concatenation\. Code is available at[https://github\.com/tamanano/EMGBlend](https://github.com/tamanano/EMGBlend)
###### Index Terms:
Electromyography, self\-supervised learning, heterogeneous pretraining, gesture recognition, force estimation
††address:1Beijing University of Posts and Telecommunications, China
2Shenzhen University, China;3Dexwise, China## 1Introduction
Surface electromyography \(EMG\) captures movement and exerted force\. Public datasets cover hand motions, typing, activities, and high\-density signals\[[20](https://arxiv.org/html/2609.25582#bib.bib10),[22](https://arxiv.org/html/2609.25582#bib.bib7),[15](https://arxiv.org/html/2609.25582#bib.bib8),[7](https://arxiv.org/html/2609.25582#bib.bib17),[14](https://arxiv.org/html/2609.25582#bib.bib16)\], but differ in arrays, sampling rates, passbands, and annotations\. Pooling these recordings could enlarge the training base for reusable EMG representations\. However, naive pooling conflates sensor identities, assigns targets outside some devices’ observable bands, and overexposes sources with more windows or channels\. BIOT provides a channel\-segment interface for cross\-dataset biosignals\[[25](https://arxiv.org/html/2609.25582#bib.bib19)\]; PhysioWave uses wavelet features and frequency\-guided masking\[[5](https://arxiv.org/html/2609.25582#bib.bib21)\]; and EMBridge uses paired EMG and pose to guide gesture transfer\[[6](https://arxiv.org/html/2609.25582#bib.bib9)\]\. Recent works explore shared\-channel multi\-task encoders\[[8](https://arxiv.org/html/2609.25582#bib.bib22)\], spectral pseudo\-labels for movement decoding\[[24](https://arxiv.org/html/2609.25582#bib.bib25)\], and quantized biosignal representations\[[3](https://arxiv.org/html/2609.25582#bib.bib26),[2](https://arxiv.org/html/2609.25582#bib.bib24)\]\. These approaches provide relevant interface, target, and transfer ingredients, but do not jointly address montage, frequency\-support, and source\-exposure mismatch\. Our contribution is the coupled design of these mechanisms for heterogeneous EMG pooling, rather than dataset concatenation alone\. We include prior systems as contextual references and use matched internal controls for the main mechanistic comparisons\.
EMGBlend therefore treats heterogeneous pooling as a coupled interface, target, and exposure problem\. First, shared channel patches and geometry\-aware temporal–spatial attention provide a common interface for variable sensor layouts\. Second, supported\-band spectral codes avoid assigning targets to frequencies absent from a recording\. Third, source\-exposure correction tempers imbalance induced jointly by corpus size and channel count\. These mechanisms require neither shared task labels nor paired pose\.
We evaluate the resulting initialization through pose\-guided gesture transfer \(Table[1](https://arxiv.org/html/2609.25582#S3.T1)\), frozen gesture recognition, continuous\-force and contact decoding, matched waveform objectives, and one\-mechanism\-at\-a\-time removals\. Fixed\-budget source controls separate source diversity from sample count, while a capacity sweep tests whether gains follow model size alone\. With the same capacity, updates, and number of windows, eleven\-source pretraining improves all four DB7 settings over a single source and remains comparable on PiMForce\. A common\-protocol comparison further evaluates an external architecture under matched downstream splits and metrics\. EMGBench’s generalization/adaptation distinction\[[26](https://arxiv.org/html/2609.25582#bib.bib15)\]motivates explicit user splits and supervision \(Sec\.[3\.1](https://arxiv.org/html/2609.25582#S3.SS1)\)\.
## 2Heterogeneity\-Aware EMG Pretraining
We pool sources𝒟=⋃s=1S𝒟s\\mathcal\{D\}=\\bigcup\_\{s=1\}^\{S\}\\mathcal\{D\}\_\{s\}, where recordingXs∈ℝCs×NsX\_\{s\}\\in\\mathbb\{R\}^\{C\_\{s\}\\times N\_\{s\}\}has source\-dependent channel count, sampling rate, frequency support, and geometryGsG\_\{s\}\(Fig\.[1](https://arxiv.org/html/2609.25582#S2.F1)\)\. The framework couples three corresponding mechanisms: a montage\-flexible interface, recording\-valid targets, and source\-exposure correction\. Task labels are used only downstream\.
Figure 1:EMGBlend’s heterogeneity\-aware architecture\. Shared Conv1D patch embeddings feed seven temporal–spatial attention pairs with sensor geometry\. The frozen tokenizer supplies code targets \(orange\); encoder features support downstream decoding \(blue\)\. Attention grids indicate axes, not measured weights\.### 2\.1Source\-aware pooling across acquisition settings
Recordings are filtered within their usable band, resampled to 1 kHz, and normalized per channel by the full recording’s median and interquartile range, including at test time as offline preprocessing\. Each channel is divided into non\-overlapping 200\-sample patches\. Available coordinates and angles accompany the signal; unknown geometry uses learned embeddings\. Resampling standardizes timing without restoring absent frequencies\.
To reduce domination by large or high\-channel\-count corpora, the loader tempers channel\-patch exposure imbalance\. Ifnsn\_\{s\}is the sum of capped channel counts across the available windows of sourcess, a candidate window is retained with probability
as\(α\)=\(minrnrns\)α\.a\_\{s\}\(\\alpha\)=\\left\(\\frac\{\\min\_\{r\}n\_\{r\}\}\{n\_\{s\}\}\\right\)^\{\\alpha\}\.\(1\)The standard recipe usesα=1/2\\alpha=1/2; theα=0\\alpha=0ablation givesas\(0\)=1a\_\{s\}\(0\)=1for every source and therefore accepts every candidate window\. Channel\-count bucketing and a nominal channel budget limit padding; at most 64 channels are sampled per window\. Available\-pool size and realized training exposure remain distinct quantities\.
### 2\.2Geometry\-aware variable\-montage encoder
A shared Conv1D patch encoder maps channels to tokens, following the channel\-segment interface of BIOT\[[25](https://arxiv.org/html/2609.25582#bib.bib19)\]\. Geometry uses coordinate Fourier features, six angular harmonics, and a 16\-bin pairwise\-distance attention bias; missing geometry uses learned embeddings\. Temporal and geometry embeddings precede alternating within\-channel temporal and across\-channel spatial attention; invalid channels are masked\. Following divided attention\[[4](https://arxiv.org/html/2609.25582#bib.bib13)\], attention computation scales asO\(CT2\+TC2\)O\(CT^\{2\}\+TC^\{2\}\)at fixed width forCCchannels andTTpatches\. The representation does not require a shared device or montage identity: geometry describes sensor arrangement without assuming anatomical registration\.
### 2\.3Supported\-band spectral\-code learning
We follow masked representation learning\[[11](https://arxiv.org/html/2609.25582#bib.bib12)\]with discrete spectral targets, drawing on vector quantization\[[23](https://arxiv.org/html/2609.25582#bib.bib20)\]and LaBraM’s neural\-spectrum prediction for EEG\[[13](https://arxiv.org/html/2609.25582#bib.bib14)\]\. A vector\-quantized tokenizer supplies one code per channel patch\. Its decoder learns the log\-amplitude spectrum of a mean\-centered patch, with reconstruction restricted to frequencies supported by that recording\. For spectral binskkand valid\-band maskbs,kb\_\{s,k\}, the reconstruction term is
ℒspec=𝔼x∼𝒟s∑kbs,k\(a^k−ak\)2∑kbs,k,\\mathcal\{L\}\_\{\\mathrm\{spec\}\}=\\mathbb\{E\}\_\{x\\sim\\mathcal\{D\}\_\{s\}\}\\frac\{\\sum\_\{k\}b\_\{s,k\}\(\\widehat\{a\}\_\{k\}\-a\_\{k\}\)^\{2\}\}\{\\sum\_\{k\}b\_\{s,k\}\},\(2\)whereak=log\(\|ℱ\(x−x¯\)k\|\+10−6\)a\_\{k\}=\\log\(\|\\mathcal\{F\}\(x\-\\bar\{x\}\)\_\{k\}\|\+10^\{\-6\}\)\. Averaging over valid bins avoids downweighting narrower passbands for having fewer bins\. Figure[2](https://arxiv.org/html/2609.25582#S2.F2)illustrates real inputs\.
The tokenizer has 8,192 EMA codes and is trained for 20k updates with 32 windows \(at most 16,384 patches\) per update using AdamW \(learning rate3×10−43\\times 10^\{\-4\}, weight decay 0\.01\), then fixed during backbone training\. Targets use original patches, including positions later hidden\. Whole\-channel and temporal masking hide raw\-patch embeddings; the encoder predicts their discrete codes from the remaining context:
ℒSSL=−𝔼X∼𝒟1\|ℳ\|∑\(c,t\)∈ℳlogpθ\(zc,t∣X~,G\)\.\\mathcal\{L\}\_\{\\mathrm\{SSL\}\}=\-\\mathbb\{E\}\_\{X\\sim\\mathcal\{D\}\}\\frac\{1\}\{\|\\mathcal\{M\}\|\}\\sum\_\{\(c,t\)\\in\\mathcal\{M\}\}\\log p\_\{\\theta\}\(z\_\{c,t\}\\mid\\widetilde\{X\},G\)\.\(3\)Hereℳ\\mathcal\{M\}contains hidden, valid positions\. Both masking fractions are 0\.25\. The common code\-prediction objective permits joint training without reconciling source gesture vocabularies or regression labels\.
Figure 2:Supported\-band target construction\. \(a\) Real emg2pose training signals with an illustrative whole\-channel/time mask; hidden patches are orange\. \(b\) Log\-amplitude spectra from ActionSense and emg2pose training patches on the same 1 kHz grid\. Gray regions are excluded from the spectral reconstruction loss\. Cutoffs reflect these recordings\.
### 2\.4Transfer to gestures and force
Frozen gestures use regularized linear classifiers on pooled features\. For adapted gestures, EMGBlend initializes EMBridge’s EMG encoder while retaining query alignment, pose reconstruction, and pose\-side assets\[[6](https://arxiv.org/html/2609.25582#bib.bib9)\]\. The encoder is frozen after adaptation for probing; “SSL” denotes pretraining, while adaptation uses pose labels\. Retrieval additionally uses a pose library\. For force, ridge regression maps frozen features to finger targets; PiMForce contact decisions threshold predictions using validation users\. Matched random encoders control feature dimension\.
## 3Experiments
### 3\.1Training and evaluation settings
Unless identified as a control or ablation, Full or SSL denotes the 109M checkpoint with width 768, seven temporal–spatial pairs, and 12 heads\. The tokenizer is trained separately and frozen before backbone pretraining\. The 462,980\-window pool comprises ActionSense\[[7](https://arxiv.org/html/2609.25582#bib.bib17)\], emg2pose\[[20](https://arxiv.org/html/2609.25582#bib.bib10)\], emg2qwerty\[[22](https://arxiv.org/html/2609.25582#bib.bib7)\], EMG\-FMFP\[[16](https://arxiv.org/html/2609.25582#bib.bib1)\], ForceBand\[[10](https://arxiv.org/html/2609.25582#bib.bib2)\], and GNI\[[15](https://arxiv.org/html/2609.25582#bib.bib8)\]\. It also includes HD\-FW\-Kin\[[9](https://arxiv.org/html/2609.25582#bib.bib18)\], Hyser\[[14](https://arxiv.org/html/2609.25582#bib.bib16)\], KIMHu \(ScienceDB HCM\)\[[12](https://arxiv.org/html/2609.25582#bib.bib3)\], multimodal glove\[[19](https://arxiv.org/html/2609.25582#bib.bib5)\], and UCI EMG\[[18](https://arxiv.org/html/2609.25582#bib.bib4)\]\. Across the released sources, channel count ranges from 2 to 448 \(capped at 64 when sampled\), recording rate from approximately 157 to 2,048 Hz, supported upper cutoff from approximately 71 to 450 Hz, and available windows per source from 752 to 171,828\. Figure[3](https://arxiv.org/html/2609.25582#S3.F3)summarizes the resulting montage, frequency\-support, and exposure heterogeneity and links each source of variation to the corresponding EMGBlend mechanism\. The final manifest contains 16,344 recordings\. Tokenizer and backbone training both exclude NinaPro, PiMForce, emg2pose’s official non\-training recordings, and the declared Hyser holdout\. The tokenizer is trained on the allowed eleven\-source pool and then frozen to supply SSL targets; it is not used in downstream inference\. Exclusions are defined by recording identity before sampling, and the consumption audit found no excluded recordings\. UCI’s nominal 1\-kHz timestamp grid contains repeated rows, so we do not infer its physical acquisition bandwidth from that grid\. Because UCI downstream subjects occurred in unlabeled pretraining, we omit UCI from transfer comparisons rather than claim subject\-disjoint generalization\. The 9M–109M models share 60k AdamW updates, 3k warmup steps, cosine decay, weight decay 0\.05, and peak learning rate1\.96×10−31\.96\\times 10^\{\-3\}\. Each of two workers has a nominal 2,048\-channel budget; bucketing makes window/token counts variable\. Under memory and stability constraints, 267M instead uses four workers, a 768\-channel budget per worker, 6k warmup, and base/effective learning rates2\.5×10−4/7\.07×10−42\.5\\times 10^\{\-4\}/7\.07\\times 10^\{\-4\}\. Our local splits differ from EMGBench’s leave\-one\-subject\-out and chronological adaptation benchmarks: pose adaptation uses training users, without test\-user calibration\.
Figure 3:Heterogeneity of the 11\-source pretraining pool\. \(a\) Released channel counts and the 64\-channel sampling cap\. \(b\) Recording\-supported frequency ranges used by the spectral target; UCI’s effective upper cutoff is uncertain\. \(c\) Naive available\-window×\\timescapped\-channel exposure before source\-aware acceptance\. The three panels motivate the montage, target, and sampling mechanisms\.Gesture protocols\.emg2pose has four seen and four unseen gesture\-stage groups\. Unseen groups are excluded from pose adaptation but labeled for probing: 12 probe users \(3,012 windows\) and 20 test users \(6,212 windows\) are disjoint\. Adaptation uses 40 epochs, batch size 256, and learning rate4×10−44\\times 10^\{\-4\}\. Linear probes use 300 AdamW steps; the SSL row in Table[1](https://arxiv.org/html/2609.25582#S3.T1)reports the mean over seeds 7 and 8\. Frozen layer/pooling choices use grouped validation within probe users\. On NinaPro DB7\[[17](https://arxiv.org/html/2609.25582#bib.bib23)\], B3/C3 use exercise B/C local IDs\{1,5,10\}\\\{1,5,10\\\}, while B4/C4 add ID 15\. Frozen final\-layer mean/std features use ten outer splits with disjoint train/test users; participants may recur across splits\. Feature scaling and regularization use nested person\-level validation\. These are defined 3/4\-class subsets rather than the full DB7 vocabulary\.
Force protocols\.NinaPro DB2/DB3 exercise 3 \(E3\)\[[1](https://arxiv.org/html/2609.25582#bib.bib6)\]uses two\-second windows and six window\-mean force targets\. Within\-person testing trains on repetitions 1/3/4/6 and tests on 2/5, over 40 DB2 and 11 DB3 participants\. Cross\-person DB2 uses five subject folds and grouped inner validation\. Feature and target scaling use training rows only, including within each inner fold\. Validation holds out training repetitions or users\. Predictions are inverted to native sensor units for MAE and standard variance\-weightedR2R^\{2\}, averaged over users\. No test\-label statistics enter prediction; conversion of native units to newtons is unverified\. Handcrafted controls use root\-mean\-square \(RMS\), mean absolute value, and waveform length\.
PiMForce\[[21](https://arxiv.org/html/2609.25582#bib.bib11)\]tests five continuous fingertip targets across 21 users in five folds\. Training/validation use S1–S2 of non\-test users; testing uses S3 of held\-out users \(21,054 windows\)\. Readouts use training\-user weighting and validation\-selected ridge regularization\. MAE is in calibrated target units\. Contact labels use a force\-sensitive resistor \(FSR\) threshold of1\.01\.0; prediction thresholds are selected on validation users\. Preprocessing is offline\. Repeats and uncertainty retain their probe or participant unit; they are not independent pretraining repetitions\.
Table 1:emg2pose gesture BA \(%\)\. LP: linear probe; Ret\.: pose retrieval\. EMGBlend averages adaptation seeds 7/8; random and local EMBridge use single runs\. Published rows are contextual references\.Table 2:Frozen 109M force decoding\. HC: handcrafted features\. NinaPro MAE uses native sensor units; PiMForce MAE uses calibrated FSR units\.Table 3:System\-level comparison with the PhysioWave architecture\[[5](https://arxiv.org/html/2609.25582#bib.bib21)\]under common downstream splits and metrics\. Pretraining setup and model capacity are not matched\. For DB5 and PiMForce, we use the officially released PhysioWave model\. Because this model was trained on EPN\-612, the EPN\-612 entry uses a retrained PhysioWave architecture\. UCI is omitted because its downstream subjects were not held out from EMGBlend pretraining\.Table 4:Unified objective, mechanism, source\-pool, and capacity controls under common frozen downstream protocols\. DB7 entries report ten\-split means; emg2pose entries average five linear\-probe initializations; and DB2/DB3 report participant\-averaged within\-subjectR2R^\{2\}\. Best values are bold and second\-best are underlined\.†Single\-source pretraining may overfit to emg2pose; its italicized emg2pose results are excluded from ranking\.∗The 267M run uses a smaller batch because of GPU memory limits, so its italicized results are reported but excluded from controlled comparisons\.
### 3\.2Gesture recognition and transfer
After pose\-guided adaptation \(Table[1](https://arxiv.org/html/2609.25582#S3.T1)\), EMGBlend reaches81\.76±0\.37%81\.76\\pm 0\.37\\%seen LP and61\.68±0\.30%61\.68\\pm 0\.30\\%unseen LP; the local EMBridge reproduction reaches 76\.62% and 49\.37%, respectively\. EMGBlend improves all four endpoints, including 12\.31 percentage points \(pp\) on unseen LP\. Since the official code, checkpoint, and exact data assignments are unavailable, this is a clean\-room comparison under our documented protocol rather than an exact benchmark reproduction\. The matched 109M random initialization reaches 68\.96% seen LP and 48\.48% unseen LP, giving SSL gains of 12\.80 and 13\.20 pp\.
Frozen controls in Table[4](https://arxiv.org/html/2609.25582#S3.T4)show the same pattern: Full improves both emg2pose groups and all evaluated gesture settings over matched random initialization while holding architecture fixed\.
### 3\.3Continuous force decoding
Within\-person DB2/DB3 favor SSL over both controls\. Cross\-person DB2 remains difficult: the SSLR2R^\{2\}is−0\.2926\-0\.2926, below both matched random \(−0\.2218\-0\.2218\) and handcrafted \(−0\.0363\-0\.0363\), so this endpoint remains a negative result rather than evidence of cross\-person force transfer\. On PiMForce, SSL reduces cross\-user MAE from random’s 2\.3802 to 2\.1204 \(10\.92%\), versus HC’s 2\.6151\. Contact BA/F1 also improve over matched random features\. MAE includes both contact and non\-contact windows, whereas BA/F1 evaluate thresholded contact state\.
### 3\.4External baselines and unified controls\.
Table[3](https://arxiv.org/html/2609.25582#S3.T3)provides a system\-level comparison under common downstream splits and metrics\. Model capacity, pretraining data, and training budget are not matched, so the comparison does not isolate SSL design\. For DB5, we use a shared downstream protocol rather than PhysioWave’s original split\.
All objective and mechanism controls use the 109M backbone, eleven\-source pool, and 60k updates\. Waveform MAE replaces the target; Generic masked MAE also disables geometry and source correction\. The remaining rows remove one mechanism at a time, and Full exceeds every such control on all 11 endpoints\.
Source\-pool controls compare emg2pose\-only, nine\-source, count\-matched eleven\-source, and full\-pool pretraining\. At matched volume, multi\-source pretraining improves gesture recognition and remains competitive for force decoding\. Scaling is non\-monotonic, so capacity alone does not explain the gains; ranking exclusions are listed in Table[4](https://arxiv.org/html/2609.25582#S3.T4)\.
## 4Conclusion
EMGBlend couples montage\-flexible inputs, supported\-band targets, and source\-balanced sampling for heterogeneous EMG pretraining\. Matched controls support each mechanism, and eleven\-source training improves all DB7 settings at fixed capacity and window budget\. Full improves PiMForce, while cross\-person force decoding remains an open challenge\.
Acknowledgments:OpenAI Codex and Claude Code assisted with language editing, implementation summaries, LaTeX organization, and code writing\. The authors verified all content and take full responsibility; no AI\-generated data or experimental results were used\.
Compliance with Ethical Standards:This study analyzes public datasets and involved no new participant recruitment, interaction, or human\-subject data collection\.
## References
- \[1\]M\. Atzoriet al\.\(2014\)Electromyography data for non\-invasive naturally\-controlled robotic hand prostheses\.Scientific Data1,pp\. 140053\.External Links:[Document](https://dx.doi.org/10.1038/sdata.2014.53)Cited by:[§3\.1](https://arxiv.org/html/2609.25582#S3.SS1.p3.1)\.
- \[2\]K\. Avramidiset al\.\(2025\)Neural codecs as biosignal tokenizers\.Note:Preprint, arXiv:2510\.09095External Links:2510\.09095,[Link](https://arxiv.org/abs/2510.09095v1)Cited by:[§1](https://arxiv.org/html/2609.25582#S1.p1.1)\.
- \[3\]K\. Barmpaset al\.\(2025\)NeuroRVQ: multi\-scale biosignal tokenization for generative foundation models\.Note:Preprint, arXiv:2510\.13068v4, 2026 revisionExternal Links:2510\.13068,[Link](https://arxiv.org/abs/2510.13068v4)Cited by:[§1](https://arxiv.org/html/2609.25582#S1.p1.1)\.
- \[4\]G\. Bertasius, H\. Wang, and L\. Torresani\(2021\)Is space\-time attention all you need for video understanding?\.InProceedings of the 38th International Conference on Machine Learning,Proceedings of Machine Learning Research, Vol\.139,pp\. 813–824\.External Links:[Link](https://proceedings.mlr.press/v139/bertasius21a.html)Cited by:[§2\.2](https://arxiv.org/html/2609.25582#S2.SS2.p1.1)\.
- \[5\]Y\. Chen, M\. Orlandi, P\. M\. Rapa, S\. Benatti, L\. Benini, and Y\. Li\(2025\)PhysioWave: a multi\-scale wavelet\-transformer for physiological signal representation\.InAdvances in Neural Information Processing Systems,Vol\.38\.External Links:[Link](https://openreview.net/forum?id=ayR2JfRYRS)Cited by:[§1](https://arxiv.org/html/2609.25582#S1.p1.1),[Table 3](https://arxiv.org/html/2609.25582#S3.T3)\.
- \[6\]W\. Cuiet al\.\(2026\)EMBridge: enhancing gesture generalization from EMG signals through cross\-modal representation learning\.InInternational Conference on Learning Representations \(ICLR\),External Links:[Link](https://openreview.net/forum?id=LqrWNdceum)Cited by:[§1](https://arxiv.org/html/2609.25582#S1.p1.1),[§2\.4](https://arxiv.org/html/2609.25582#S2.SS4.p1.1),[Table 1](https://arxiv.org/html/2609.25582#S3.T1.2.5.1.1),[Table 1](https://arxiv.org/html/2609.25582#S3.T1.2.6.1.1)\.
- \[7\]J\. DelPretoet al\.\(2022\)ActionSense: a multimodal dataset and recording framework for human activities using wearable sensors in a kitchen environment\.InAdvances in Neural Information Processing Systems \(NeurIPS\) Datasets and Benchmarks Track,External Links:[Link](https://action-sense.csail.mit.edu/)Cited by:[§1](https://arxiv.org/html/2609.25582#S1.p1.1),[§3\.1](https://arxiv.org/html/2609.25582#S3.SS1.p1.1)\.
- \[8\]M\. Fasulo, G\. Spacone, T\. M\. Ingolfsson, Y\. Li, L\. Benini, and A\. Cossettini\(2025\)TinyMyo: a tiny foundation model for flexible EMG signal processing at the edge\.Note:Preprint, arXiv:2512\.15729v2, 2026 revisionExternal Links:2512\.15729,[Link](https://arxiv.org/abs/2512.15729v2)Cited by:[§1](https://arxiv.org/html/2609.25582#S1.p1.1)\.
- \[9\]W\. Guo, Z\. Zhao, Z\. Zhou, Y\. Fang, Y\. Yu, and X\. Sheng\(2025\)Hand kinematics, high\-density sEMG comprising forearm and far\-field potentials for motion intent recognition\.Scientific Data12,pp\. 445\.External Links:[Document](https://dx.doi.org/10.1038/s41597-025-04749-8)Cited by:[§3\.1](https://arxiv.org/html/2609.25582#S3.SS1.p1.1)\.
- \[10\]B\. Heet al\.\(2026\)ForceBand: learning forceful manipulation with sEMG\.External Links:2606\.26093,[Link](https://arxiv.org/abs/2606.26093)Cited by:[§3\.1](https://arxiv.org/html/2609.25582#S3.SS1.p1.1)\.
- \[11\]K\. He, X\. Chen, S\. Xie, Y\. Li, P\. Dollár, and R\. Girshick\(2022\)Masked autoencoders are scalable vision learners\.InProceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition,pp\. 16000–16009\.External Links:[Link](https://openaccess.thecvf.com/content/CVPR2022/html/He_Masked_Autoencoders_Are_Scalable_Vision_Learners_CVPR_2022_paper.html)Cited by:[§2\.3](https://arxiv.org/html/2609.25582#S2.SS3.p1.1)\.
- \[12\]Ó\. G\. Hernándezet al\.\(2023\)A kinematic, imaging and electromyography dataset for human muscular manipulability index prediction\.Scientific Data10,pp\. 132\.Note:Dataset:[https://doi\.org/10\.57760/sciencedb\.01902](https://doi.org/10.57760/sciencedb.01902)External Links:[Document](https://dx.doi.org/10.1038/s41597-023-02031-3)Cited by:[§3\.1](https://arxiv.org/html/2609.25582#S3.SS1.p1.1)\.
- \[13\]W\. Jiang, L\. Zhao, and B\. Lu\(2024\)Large brain model for learning generic representations with tremendous EEG data in BCI\.InInternational Conference on Learning Representations,External Links:[Link](https://openreview.net/forum?id=QzTpTRVtrP)Cited by:[§2\.3](https://arxiv.org/html/2609.25582#S2.SS3.p1.1)\.
- \[14\]X\. Jianget al\.\(2021\)Open access dataset, toolbox and benchmark processing results of high\-density surface electromyogram recordings\.IEEE Transactions on Neural Systems and Rehabilitation Engineering29,pp\. 1035–1046\.External Links:[Document](https://dx.doi.org/10.1109/TNSRE.2021.3082551)Cited by:[§1](https://arxiv.org/html/2609.25582#S1.p1.1),[§3\.1](https://arxiv.org/html/2609.25582#S3.SS1.p1.1)\.
- \[15\]P\. Kaifosh, T\. R\. Reardon, and CTRL\-labs at Reality Labs\(2025\)A generic non\-invasive neuromotor interface for human\-computer interaction\.Nature645\.External Links:[Document](https://dx.doi.org/10.1038/s41586-025-09255-w)Cited by:[§1](https://arxiv.org/html/2609.25582#S1.p1.1),[§3\.1](https://arxiv.org/html/2609.25582#S3.SS1.p1.1)\.
- \[16\]Y\. Kosteley, D\. Zhdanov, and A\. Seleznev\(2026\)EMG dataset for predicting forearm muscle force exerted during dynamometer squeezing \(different signal capture factors\) \(EMG\-FMFP\)\.Note:Mendeley Data, version 1[https://doi\.org/10\.17632/2prvk292rp\.1](https://doi.org/10.17632/2prvk292rp.1)External Links:[Document](https://dx.doi.org/10.17632/2prvk292rp.1),[Link](https://data.mendeley.com/datasets/2prvk292rp/1)Cited by:[§3\.1](https://arxiv.org/html/2609.25582#S3.SS1.p1.1)\.
- \[17\]A\. Krasoulis, I\. Kyranou, M\. S\. Erden, K\. Nazarpour, and S\. Vijayakumar\(2017\)Improved prosthetic hand control with concurrent use of myoelectric and inertial measurements\.Journal of NeuroEngineering and Rehabilitation14,pp\. 71\.External Links:[Document](https://dx.doi.org/10.1186/s12984-017-0284-4)Cited by:[§3\.1](https://arxiv.org/html/2609.25582#S3.SS1.p2.1)\.
- \[18\]N\. Krilova, I\. Kastalskiy, V\. B\. Kazantsev, V\. A\. Makarov, and S\. Lobov\(2018\)EMG data for gestures\.Note:UCI Machine Learning RepositoryExternal Links:[Document](https://dx.doi.org/10.24432/C5ZP5C),[Link](https://archive.ics.uci.edu/dataset/481/emg+data)Cited by:[§3\.1](https://arxiv.org/html/2609.25582#S3.SS1.p1.1)\.
- \[19\]I\. Kyranou, K\. Szymaniak, and K\. Nazarpour\(2025\)EMG dataset for gesture recognition with arm translation\.Scientific Data12,pp\. 100\.External Links:[Document](https://dx.doi.org/10.1038/s41597-024-04296-8)Cited by:[§3\.1](https://arxiv.org/html/2609.25582#S3.SS1.p1.1)\.
- \[20\]S\. Salteret al\.\(2024\)Emg2pose: a large and diverse benchmark for surface electromyographic hand pose estimation\.InAdvances in Neural Information Processing Systems \(NeurIPS\), Datasets and Benchmarks Track,Vol\.37\.External Links:2412\.02725,[Link](https://proceedings.neurips.cc/paper_files/paper/2024/hash/64f8884f6ba3d9ace5bb647c4f917896-Abstract-Datasets_and_Benchmarks_Track.html)Cited by:[§1](https://arxiv.org/html/2609.25582#S1.p1.1),[§3\.1](https://arxiv.org/html/2609.25582#S3.SS1.p1.1),[Table 1](https://arxiv.org/html/2609.25582#S3.T1.2.7.1.1)\.
- \[21\]K\. Seo, J\. Seo, H\. Jeong, S\. Kim, and S\. H\. Yoon\(2024\)Posture\-informed muscular force learning for robust hand pressure estimation\.InAdvances in Neural Information Processing Systems \(NeurIPS\),Vol\.37\.External Links:2410\.23629,[Link](https://proceedings.neurips.cc/paper_files/paper/2024/hash/a01e69aa9c3c61fcb40ea378e71fc780-Abstract-Conference.html)Cited by:[§3\.1](https://arxiv.org/html/2609.25582#S3.SS1.p4.1)\.
- \[22\]V\. Sivakumaret al\.\(2024\)Emg2qwerty: a large dataset with baselines for touch typing using surface electromyography\.InAdvances in Neural Information Processing Systems, Datasets and Benchmarks Track,Vol\.37\.Cited by:[§1](https://arxiv.org/html/2609.25582#S1.p1.1),[§3\.1](https://arxiv.org/html/2609.25582#S3.SS1.p1.1)\.
- \[23\]A\. van den Oord, O\. Vinyals, and K\. Kavukcuoglu\(2017\)Neural discrete representation learning\.InAdvances in Neural Information Processing Systems,Vol\.30\.External Links:[Link](https://arxiv.org/abs/1711.00937)Cited by:[§2\.3](https://arxiv.org/html/2609.25582#S2.SS3.p1.1)\.
- \[24\]Z\. Wenget al\.\(2025\)SPECTRE: spectral pre\-training embeddings with cylindrical temporal rotary position encoding for fine\- grained sEMG\-based movement decoding\.Note:Preprint, arXiv:2512\.22481External Links:2512\.22481,[Link](https://arxiv.org/abs/2512.22481)Cited by:[§1](https://arxiv.org/html/2609.25582#S1.p1.1)\.
- \[25\]C\. Yang, M\. B\. Westover, and J\. Sun\(2023\)BIOT: biosignal transformer for cross\-data learning in the wild\.InAdvances in Neural Information Processing Systems,Vol\.36\.External Links:[Link](https://arxiv.org/abs/2305.10351)Cited by:[§1](https://arxiv.org/html/2609.25582#S1.p1.1),[§2\.2](https://arxiv.org/html/2609.25582#S2.SS2.p1.1)\.
- \[26\]J\. Yang, M\. Soh, V\. Lieu, D\. J\. Weber, and Z\. Erickson\(2024\)EMGBench: benchmarking out\-of\-distribution generalization and adaptation for electromyography\.InAdvances in Neural Information Processing Systems \(NeurIPS\), Datasets and Benchmarks Track,Vol\.37\.External Links:2410\.23625Cited by:[§1](https://arxiv.org/html/2609.25582#S1.p3.1)\.Similar Articles
Recognition and Label-Free Adaptation Across Recording Sessions in Surface-EMG Gesture Decoding
This paper introduces a montage-agnostic encoder for surface-EMG gesture decoding that maintains recognition accuracy across recording sessions without recalibration, and shows that feature-statistic alignment at test time improves adaptation on NinaPro DB6.
Multimodal Surface EMG Hand Gesture Recognition Using Query-Based Transformers for Prosthetic Control
This paper introduces EMG-CrossFormer, a hybrid convolutional-transformer model for multimodal sEMG hand gesture recognition, which achieves state-of-the-art accuracy on NinaPro datasets by fusing sEMG and inertial signals via cross-attention.
A Montage-Agnostic Encoder for Calibration-Light Cross-User Gesture Recognition from Surface Electromyography
Introduces a montage-agnostic encoder for calibration-light cross-user gesture recognition from surface EMG, using shared weights and electrode coordinates to handle variable channel counts and reduce per-user calibration. It outperforms per-user baselines on some datasets and analyzes factors affecting cross-user transfer.
Multi-Subject Pretraining Enables Short-Calibration Personalization for Closed-Corpus Surface EMG Speech Decoding
This paper proposes a multi-subject pretraining approach for surface EMG speech decoding that reduces calibration time while improving accuracy, achieving a character error rate of 21.7% with just three minutes of target-subject data.
Scaling Mixture-of-Experts Video Pretraining for Embodied Intelligence
LingBot-Video presents a DiT-based video pretraining framework with Mixture-of-Experts architecture, specialized data augmentation, and multi-dimensional reward system for embodied intelligence applications.