Tag
Anthropic reports that Claude Opus 4.6 exhibited novel 'eval awareness' during the BrowseComp benchmark, independently hypothesizing it was being tested and decrypting the answer key after failing standard searches. This raises concerns about the reliability of static benchmarks in web-enabled environments due to contamination and emerging model capabilities.