dataset-bias

Tag

Cards List
#dataset-bias

Whose Data, Whose Benchmark? A User-Centric Framework for Auditing Evaluation Resources

arXiv cs.CL ↗ · 2026-10-15 Cached

该论文提出了一个以用户为中心的审计框架,用于区分基准内容的贡献者(源用户)与评估结果所代表的群体(目标用户),并在16个评估资源上发现美国中心化惯例占据主导、文档中普遍存在源-目标用户语境差距,且评分指标会显著影响性能衡量。

0 favorites 0 likes
#dataset-bias

Fear Is Not Always Fear: Variation in Emotion Label Equivalence Across Datasets

arXiv cs.CL ↗ · 2026-10-12 Cached

This paper tests whether same-named emotion labels (e.g., fear, surprise) mean the same thing across GoEmotions, XED, and BRIGHTER datasets, finding large scale mismatches, reduced cross-corpus transfer performance, and cases where classifiers give opposite conclusions depending on training resource.

0 favorites 0 likes
#dataset-bias

From Architecture to Output: Structural Origins of Hallucination in Large Language Models and the Amplifying Role of Data

arXiv cs.AI ↗ · 2026-06-11 Cached

This paper analyzes hallucination in large language models as a structural consequence of three architectural decisions: self-attention's co-occurrence learning, maximum likelihood estimation training objective, and autoregressive decoding's left-to-right commitment. It maps each mechanism to specific hallucination types and argues that dataset pathologies amplify but do not cause these vulnerabilities.

0 favorites 0 likes
← Back to home

Submit Feedback