test-security

Tag

Cards List
#test-security

If you lock the tests your agent is judged against, what stops it changing what runs them?

Reddit r/AI_Agents ↗ · 2026-10-19

The author describes how locking down an agent's test suite can be bypassed without touching test files — via a new conftest.py or a modified pytest.ini that silently changes test collection while pytest still exits 0 — and asks what other holes people already live with and how to keep false-hold rates low enough that protections aren't ignored.

0 favorites 0 likes
← Back to home

Submit Feedback