detectability

Tag

Cards List
#detectability

When Is Benchmark Contamination Detectable? Information Limits and Power-Calibrated Audits

arXiv cs.AI ↗ · 2026-08-11 Cached

This paper formalizes when benchmark contamination is detectable, deriving information-theoretic limits and proposing power-calibrated audits that distinguish a clean benchmark from a powerless detector. It reports two-sided empirical findings on calibration efficacy and validity gates.

0 favorites 0 likes
#detectability

A Linguistics-Aware LLM Watermarking via Syntactic Predictability

arXiv cs.CL ↗ · 2026-04-20 Cached

This paper introduces STELA, a linguistics-aware watermarking framework for LLMs that leverages syntactic predictability via POS n-grams to balance text quality and detection robustness. The method enables publicly verifiable watermark detection without requiring access to model logits, demonstrating superior performance across typologically diverse languages (English, Chinese, Korean).

0 favorites 0 likes
← Back to home

Submit Feedback