Anyone running AI agents in production with proper orchestration?

Reddit r/AI_Agents News

Summary

A developer asks for recommendations on production orchestration tools for multi-agent AI workflows with branching, retries, and human-in-the-loop approvals, as their current FastAPI-based solution has become unmaintainable.

We have a multi agent setup where different LLMs handle different parts of a pipeline : classification, extraction and human review loop. Right now the orchestration is a fastAPI app with a bunch of if / else and try / except blocks, and it's becoming unmaintainable. Retries are hacky, there's no visibility into where a run failed, and adding a new agent step means touching spaghetti code every time. I need sth that can handle multi step AI workflows with branching, retries and ideally human in the loop approvals w/o writing the orchestration logic from scratch. What are people using for this in production?
Original Article

Similar Articles