AGVBench: A Reliability-Oriented Benchmark of Data Augmentation for Vein Recognition
Summary
AGVBench is a reliability-oriented benchmark for data augmentation in vein recognition, evaluating 30 augmentation strategies across multiple datasets and backbones, revealing decoupling between accuracy and security.
View Cached Full Text
Cached at: 07/03/26, 11:54 AM
Paper page - AGVBench: A Reliability-Oriented Benchmark of Data Augmentation for Vein Recognition
Source: https://huggingface.co/papers/2607.02271 TL;DR: We open-source AGVBench, the first reliability-oriented benchmark for data augmentation in vein recognition. By systematically evaluating 30 representative augmentation strategies across 5 public palm- and finger-vein datasets using 7 backbone architectures, we demonstrate that accuracy-centric evaluation alone is insufficient for assessing the reliability of biometric recognition systems.
📌 Key Findings:
🔹 Accuracy–Security Decoupling: Multi-image mixing methods (e.g., MixUp and PuzzleMix) generally achieve the strongest recognition performance. However, they are often poorly calibrated and more vulnerable to adversarial perturbations, revealing a clear inconsistency between clean accuracy and adversarial security.
🔹 Degradation from Geometric Transformations: Severe geometric transformations consistently degrade recognition performance, likely due to feature misalignment or spatial cropping, rather than direct disruption of vein topology.
🔹 Modality Variations: The effectiveness of augmentation strategies varies substantially across palm-vein and finger-vein datasets, indicating that no single augmentation strategy universally generalizes across different vein modalities.
🚀 Beyond benchmarking, AGVBench aims to serve as an open research platform for reliability-oriented vein recognition, promoting reproducible evaluation, inspiring the development of next-generation augmentation algorithms, and advancing the deployment of trustworthy biometric systems in real-world applications.
🏠 Project Page:https://advance-veintech-innovators.github.io/AGVBench/
📄 ArXiv Paper:https://arxiv.org/abs/2607.02271
💻 Code & Benchmark:https://github.com/Advance-VeinTech-Innovators/AGVBench
Similar Articles
VEFX-Bench: A Holistic Benchmark for Generic Video Editing and Visual Effects
VEFX-Bench introduces a large-scale human-annotated video editing dataset (5,049 examples) with multi-dimensional quality labels and a specialized reward model for standardized evaluation of video editing systems. The paper addresses the lack of comprehensive benchmarks in AI-assisted video creation by providing VEFX-Dataset, VEFX-Reward, and a 300-video-prompt benchmark that reveals gaps in current editing models.
MSAVBench: Towards Comprehensive and Reliable Evaluation of Multi-Shot Audio-Video Generation
MSAVBench is the first comprehensive benchmark and adaptive evaluation framework for multi-shot audio-video generation, assessing 19 models across diverse tasks and achieving high alignment with human judgment.
VIABench: A Comprehensive Video Benchmark Collected from Blind Individuals for Visual Impairment Assistance
Introduces VIABench, a comprehensive video benchmark for evaluating multimodal large language models in real-world visual assistance for blind and visually impaired individuals, covering 761 videos and 14,526 annotations across three tasks.
BVB: Benchmarking Agentic Video Understanding via Programmatic Reconstruction in Blender
The paper introduces BVB, a benchmark for agentic video understanding via programmatic reconstruction in Blender, evaluating models on perceptual similarity and spatiotemporal fact retention.
Identifying and Resolving Pitfalls of Knowledge-Based VQA Benchmarks: Auditing, Repairing, and Augmenting
This paper audits knowledge-based VQA benchmarks, revealing systematic violations of assumptions that make accuracy a misleading metric. It introduces a repair protocol and multi-entity augmentation to restore answer derivability and question clarity, showing that corrected settings yield markedly different model rankings.
