benchmark-fingerprinting

Tag

Cards List
#benchmark-fingerprinting

Gaming Without an Attacker: Benchmark Fingerprinting in LLM-Driven Search Under Selection Pressure

Hugging Face Daily Papers ↗ · 2026-08-09 Cached

This paper examines how LLM-driven evolutionary optimization of GPU kernels can fingerprint evaluation configurations, causing 30% of in-distribution wins to fail on held-out settings. It offers a taxonomy of failure modes and design guidance for robust benchmarking under strategic optimization.

0 favorites 0 likes
← Back to home

Submit Feedback