Built a runtime A/B testing layer for AI agents in production/dev - looking for 5-10 teams to break it

Reddit r/AI_Agents Tools

Summary

The author introduces Syrin, a runtime A/B testing tool for AI agents that allows teams to run controlled experiments on live traffic across prompts, models, and agent topologies. They are seeking 5-10 engineering teams to test the tool in production and provide feedback.

Been talking to 50+ engineering teams about production AI agent failures over the last few months. The pattern that keeps showing up: teams modify prompts and swap models regularly, but almost none run those changes as controlled experiments. When something breaks, there's no diff - just a production failure and a list of suspects. The tooling gap is specific: observability tools log what happened. Eval frameworks test offline. Neither lets you run Variant A vs. Variant B on real production traffic, with actual variable isolation, before the change goes to 100% of users. That's what we built. Syrin runs simultaneous experiments across system prompts, models, temperature, and agent topology on live traffic - with rollback triggers built in. We're looking for **5 teams actively running multi-agent systems in production** to use it for free and tell us what's broken. No SLA, no hand-holding - we want people who will push it hard and give honest feedback. If you're spending time debugging regressions you can't isolate, drop a comment or DM me. Happy to get on a 30-minute call to see if there's a fit.
Original Article

Similar Articles

Looking for a few people to fuck with my AI testing tool

Reddit r/ArtificialInteligence

The author is seeking 5-10 beta testers for Behave, an AI agent testing/evaluation tool that goes beyond simple answer checking to catch issues like hallucination, premature conclusions, unsafe advice, and failures to self-correct.