Tag
一篇系统综述,回顾了119篇关于大语言模型基准压缩的论文,提出了涵盖单基准内压缩、跨基准套件压缩及自适应评估的分类体系,旨在降低LLM评估成本并提升可靠性。
ZipBench presents a low-cost framework for compressing large language model benchmarks, reducing evaluation expenses while maintaining accuracy, and introduces ZipBench Zoo with compact benchmark versions.
Introduces DualEval, a framework that jointly calibrates model ability and item difficulty/sharpness to unify static benchmark and arena-style evaluation, enabling more reliable rankings and downstream applications like benchmark compression and anomaly detection.