AGVBench: A Reliability-Oriented Benchmark of Data Augmentation for Vein Recognition

Hugging Face Daily Papers Papers

Summary

AGVBench is a reliability-oriented benchmark for data augmentation in vein recognition, evaluating 30 augmentation strategies across multiple datasets and backbones, revealing decoupling between accuracy and security.

Vein recognition is a secure biometric technology often constrained by limited annotated data and imaging variations. While data augmentation mitigates this, strategies designed for natural images may disrupt the fine-grained topology and textures essential for identity discrimination. We present AGVBench, which evaluates 30 representative augmentation strategies on five public palm- and finger-vein datasets with seven backbone architectures, covering classic CNNs, vision transformers, and vein-specific recognition models. Our results show that multi-image mixing methods (e.g., MixUp, PuzzleMix, StarMixup) generally provide the strongest recognition performance. However, they are often poorly calibrated and vulnerable to adversarial perturbations, revealing a clear inconsistency between clean accuracy and adversarial security. We also find that severe geometric transformations frequently degrade recognition, which is potentially due to feature misalignment or spatial cropping, and that augmentation effectiveness varies across palm and finger vein datasets. These findings prove that accuracy-centric evaluation is insufficient for biometric augmentation. AGVBench provides standardized protocols to support reproducible research and guide the design of reliable, secure, and robust vein recognition systems. Our codebase is available at https://github.com/Advance-VeinTech-Innovators/AGVBench.
Original Article
View Cached Full Text

Cached at: 07/03/26, 11:54 AM

Paper page - AGVBench: A Reliability-Oriented Benchmark of Data Augmentation for Vein Recognition

Source: https://huggingface.co/papers/2607.02271 TL;DR: We open-source AGVBench, the first reliability-oriented benchmark for data augmentation in vein recognition. By systematically evaluating 30 representative augmentation strategies across 5 public palm- and finger-vein datasets using 7 backbone architectures, we demonstrate that accuracy-centric evaluation alone is insufficient for assessing the reliability of biometric recognition systems.

image

📌 Key Findings:

🔹 Accuracy–Security Decoupling: Multi-image mixing methods (e.g., MixUp and PuzzleMix) generally achieve the strongest recognition performance. However, they are often poorly calibrated and more vulnerable to adversarial perturbations, revealing a clear inconsistency between clean accuracy and adversarial security.

🔹 Degradation from Geometric Transformations: Severe geometric transformations consistently degrade recognition performance, likely due to feature misalignment or spatial cropping, rather than direct disruption of vein topology.

🔹 Modality Variations: The effectiveness of augmentation strategies varies substantially across palm-vein and finger-vein datasets, indicating that no single augmentation strategy universally generalizes across different vein modalities.

🚀 Beyond benchmarking, AGVBench aims to serve as an open research platform for reliability-oriented vein recognition, promoting reproducible evaluation, inspiring the development of next-generation augmentation algorithms, and advancing the deployment of trustworthy biometric systems in real-world applications.

🏠 Project Page:https://advance-veintech-innovators.github.io/AGVBench/

📄 ArXiv Paper:https://arxiv.org/abs/2607.02271

💻 Code & Benchmark:https://github.com/Advance-VeinTech-Innovators/AGVBench

Similar Articles

VEFX-Bench: A Holistic Benchmark for Generic Video Editing and Visual Effects

Hugging Face Daily Papers

VEFX-Bench introduces a large-scale human-annotated video editing dataset (5,049 examples) with multi-dimensional quality labels and a specialized reward model for standardized evaluation of video editing systems. The paper addresses the lack of comprehensive benchmarks in AI-assisted video creation by providing VEFX-Dataset, VEFX-Reward, and a 300-video-prompt benchmark that reveals gaps in current editing models.