audit-initiative

Tag

Cards List
#audit-initiative

@charliermarsh: Lots of good examples in these reports. For example: in DeepSWE v1.1, the verifier discards the agent's changes to some…

X AI KOLs Following · 5d ago Cached

Epoch AI introduces Benchmark Reviews to audit AI benchmarks, revealing flaws such as in DeepSWE v1.1 where the verifier discards changes without informing the model, leading to failures.

0 favorites 0 likes
← Back to home

Submit Feedback