I built an AI support-agent prototype and realized the hard part is not the chatbot it is the handoff and audit trail. Looking for critique from people who run support/CX workflows.

Reddit r/AI_Agents Tools

Summary

The author built RelayOps, an AI support agent prototype for telecom/subscription support, and shares results from a 50-ticket sample, seeking critique on handoff records, unsafe actions, audit fields, and usefulness for testing.

I’ve been building RelayOps, a prototype AI support agent for telecom/subscription-style support. The goal is not just “answer the user.” I’m testing a narrower question: > Current version: * processes a sample support-ticket queue * auto-resolves low-risk reversible cases * escalates billing/account-risk cases * blocks unsafe actions * writes one audit record per ticket * creates human handoff tickets with owner/reason/evidence/deadline * shows decisions in a live console * exports JSONL/CSV audit records On my current 50-ticket sample queue: * 27 auto-resolved * 20 human handoffs * 3 unsafe blocks * 0 unsafe auto-actions * 0 billing escapes Important caveat: this is sample data, not production traffic. I’m not claiming product validation yet. The part I’m trying to understand now: For people who have run support, CX, SaaS ops, or billing/account workflows: 1. What would you need in the handoff record before trusting an AI agent to escalate correctly? 2. What actions would you never allow an agent to auto-execute? 3. What audit fields would matter if a customer later disputes the decision? 4. What would make this useful enough to test on anonymized tickets? Please do comment for repo or demo.
Original Article

Similar Articles

Improving support with every interaction at OpenAI

OpenAI Blog

OpenAI shares how it reimagined its support operations using AI to handle millions of requests annually by creating an operating model where every interaction improves the next. The approach combines chat/email/phone surfaces, continuously improving knowledge bases, and human-AI evaluation loops that empower support reps to act as builders and inform product improvements.