Built a runtime A/B testing layer for AI agents in production/dev - looking for 5-10 teams to break it
Summary
The author introduces Syrin, a runtime A/B testing tool for AI agents that allows teams to run controlled experiments on live traffic across prompts, models, and agent topologies. They are seeking 5-10 engineering teams to test the tool in production and provide feedback.
Similar Articles
Looking for a few people to fuck with my AI testing tool
The author is seeking 5-10 beta testers for Behave, an AI agent testing/evaluation tool that goes beyond simple answer checking to catch issues like hallucination, premature conclusions, unsafe advice, and failures to self-correct.
got tired of AI agent demos that only show the happy path, so we built a place to make them fail
A developer built Battle Agents, a platform for testing AI agents in controlled failure scenarios to inspect decisions, tool calls, and recovery, and is seeking community feedback.
An open-source tool for testing AI agent behavior before they go into production.
The author plans to open-source a tool for testing AI agent behavior before production, supporting OpenAI Agents SDK, PydanticAI, and custom Python agents, and is seeking developer contributions and feedback.
I got tired of AI agents silently failing in production, so I built a runtime control layer for them
The author built a runtime control layer to address the problem of AI agents failing silently in production environments.
How are you testing your agents before deploying? Or is everyone just vibes-checking in prod?
A discussion on the challenges of testing non-deterministic AI agents, questioning how developers validate tool usage, behavior, and multi-step workflows without traditional testing patterns.