A developer shares an experiment with an AI agent-based automation platform that builds and manages deterministic workflows, seeking feedback from the community.
I work in a small company and have always enjoyed automating workflows for myself and my team, starting out with macros many years ago, then python and then in the last year, agents. But while it's been fun to play around with, most of the stuff that needs to be automated doesn't actually need an agent on each run. It's deterministic stuff, too tedious or time consuming to do manually each time, maybe with 1 or 2 judgements needed along the way but the process is always the same. So over the last months we've been experimenting with our own "automation platform", which is a combination of an AI agent that builds the automations (using Claude or ChatGPT subscriptions so no token cost to worry about), and a "workflow and runtime management layer", that catches errors, tracks issues, manages credentials etc. The agent writes the automations in a very specific structure where it tests everything along the way, writes input and output validation per step, documents how it works etc. If a step fails the platform will catch it and alert the owner for review, and if the agent needs to fix something it will analyse the issue, propose a plan and get approval before doing anything, instead of going off on its own. A typical automation build uses 2-3x the amount of tokens as just having an AI agent do it once, but after that it's either 100% code, or maybe with a few simple AI steps that cost a couple thousand tokens on a cheap model. We think it would be cool to share with others, get some feedback on it and build something we can use for more and more things, but because it's not just a harness it needs a bit of polish before we push it out there. So to judge how to prioritise it I wanted to ask if anyone else have done something similar? Is it something you think could be useful - and what would be your concerns?
A discussion about whether AI agents can reliably automate complex, multi-step workflows without constant human supervision, asking about current limitations and experiences.
A web developer shares experiences building systems around AI coding agents for reliable development and seeks advice on workflows and orchestration tools.
A researcher asks the AI agent-building community whether they would let their agent participate in someone else's workflow, exploring trust, access control, approval workflows, and monetization models for a marketplace of specialized agents built and owned by different people.
The article discusses methods to evaluate the anonymous AI model Space Bunny for agent workflows, focusing on stateful testing, error recovery, and consistency to ensure reliability.