Anyone else lose track of which version of a prompt is the "good" one? I ended up building version control for prompts
Summary
The author describes building a version control system for AI prompts to solve the problem of tracking which prompt version is best.
Similar Articles
We somehow ended up with three different versions of the same prompt in production
A developer describes chasing a model regression that turned out to be three different versions of the same prompt running in production due to hotfixes and incomplete merges, leading to adoption of a prompt management tool (OrqAI) for version visibility.
How are you letting non-engineer teammates edit prompts in production?
The author discusses challenges in allowing subject matter experts to edit prompts in production for AI agents in regulated domains, and shares a solution using a prompt editor with GitHub backend for version control.
asgeirtj/system_prompts_leaks
A GitHub repository documenting leaked system prompts for major AI chatbots like Claude, ChatGPT, and Gemini, tracking changes across versions.
We found four different versions of "the" system prompt and none of us could say which one was live
Researchers discovered four different versions of 'the' system prompt in a live AI model, highlighting confusion over which version is actually deployed.
@leanxbt: https://x.com/leanxbt/status/2070852461494202609
A detailed article introducing Loop Prompt Engineering, a method to automate prompt optimization by iteratively rewriting prompts based on evaluation against a dataset, with emphasis on avoiding recursive traps.