benchmark-compression

Tag

Cards List
#benchmark-compression

Are We Testing Too Much? A Survey of Benchmark Compression for Efficient Evaluation of Large Language Models

Hugging Face Daily Papers ↗ · 2026-10-13 Cached

一篇系统综述,回顾了119篇关于大语言模型基准压缩的论文,提出了涵盖单基准内压缩、跨基准套件压缩及自适应评估的分类体系,旨在降低LLM评估成本并提升可靠性。

0 favorites 0 likes
#benchmark-compression

Zipbench: Low-Cost Framework for Compressing Comprehensive Benchmarks of Large Language Models

arXiv cs.CL ↗ · 2026-09-14 Cached

ZipBench presents a low-cost framework for compressing large language model benchmarks, reducing evaluation expenses while maintaining accuracy, and introduces ZipBench Zoo with compact benchmark versions.

0 favorites 0 likes
#benchmark-compression

DualEval: Joint Model-Item Calibration for Unified LLM Evaluation

arXiv cs.LG ↗ · 2026-06-26 Cached

Introduces DualEval, a framework that jointly calibrates model ability and item difficulty/sharpness to unify static benchmark and arena-style evaluation, enabling more reliable rankings and downstream applications like benchmark compression and anomaly detection.

0 favorites 0 likes
← Back to home

Submit Feedback