Tag
Close shares how they evolved their CI pipeline to run nearly 58,000 integration tests in under 3 minutes using orchestrated, dynamically split pytest workers across multiple runners, replacing sequential runs and simple fixed test splitting.
The author describes how locking down an agent's test suite can be bypassed without touching test files — via a new conftest.py or a modified pytest.ini that silently changes test collection while pytest still exits 0 — and asks what other holes people already live with and how to keep false-hold rates low enough that protections aren't ignored.
SineFrame M3 is an open-source (Apache-2.0) pytest-based tool for testing MCP servers and verifying the tool calls made by real agents like Claude Code, Codex, OpenCode, and Pi, with trace visualization and CI gating support.
pytest-leak-finder is a pytest plugin that uses binary search to identify which earlier test causes a later test to fail when run together.
A blog post examining Pluggy, a Python library for building plugin systems originally from pytest, including how it works and how to use it with a toy HTML conversion tool.