contrastive-evaluation

Tag

Cards List
#contrastive-evaluation

Contrastive ESA: Human Evaluation of Multiple Translations at Once

arXiv cs.CL · 2026-07-30 Cached

Introduces Contrastive Error Span Annotation (cESA), a protocol for human evaluation of multiple translations simultaneously, reducing annotation time and noise compared to standard methods.

0 favorites 0 likes
#contrastive-evaluation

SkillAudit: Ground-Truth-Free Skill Evolution via Paired Trajectory Auditing

arXiv cs.AI · 2026-06-15 Cached

SkillAudit introduces a framework for evolving LLM agent skills without ground-truth feedback by using paired trajectory auditing and contrastive evaluation. It achieves 73.9% average task reward across 89 tasks, outperforming baseline methods.

0 favorites 0 likes
← Back to home

Submit Feedback