We somehow ended up with three different versions of the same prompt in production
Summary
A developer describes chasing a model regression that turned out to be three different versions of the same prompt running in production due to hotfixes and incomplete merges, leading to adoption of a prompt management tool (OrqAI) for version visibility.
Similar Articles
Anyone else lose track of which version of a prompt is the "good" one? I ended up building version control for prompts
The author describes building a version control system for AI prompts to solve the problem of tracking which prompt version is best.
How are you letting non-engineer teammates edit prompts in production?
The author discusses challenges in allowing subject matter experts to edit prompts in production for AI agents in regulated domains, and shares a solution using a prompt editor with GitHub backend for version control.
How are teams handling prompt QA at scale?
A practitioner at a company handling ~40k conversations/month describes the bottleneck of manual prompt QA and asks how teams are using automated systems to detect regressions and user frustration in production.
Same model, same prompt, 4 different agents
Explores how different agent architectures yield varying outputs from the same underlying model and prompt, highlighting the impact of agent design on LLM behavior.
Same agent, same prompt, different runs. Which output do you ship?
The author observes that running the same task with Claude Code across different sessions yields varying decision patterns, making it hard to choose outputs that are safe to ship, and highlights the lack of tooling for evaluating agent decision profiles.