A structured path for learning to build voice agents, from your first STT call to production

Reddit r/AI_Agents Tools

Summary

A curated, open-source learning path for building voice agents, covering from STT to production, with 190+ resources and a 5-week plan.

Voice is one of the harder agent modalities to break into, because the knowledge is spread across a dozen vendors and the failure modes (latency, turn-taking) don't show up until they bite you. I maintain a curated learning path that tries to fix that, free and open source (MIT). It's ordered the way the work actually goes: \- Foundations: the STT to LLM to TTS pipeline and the latency budget you fight forever \- Frameworks: pick one (LiveKit Agents or Pipecat for open-source) and ship a hello-world \- Components: swap STT, TTS, LLM, VAD, and turn detection to learn what each layer does \- Telephony: connect a real phone number over SIP \- Evaluation and production: make it safe enough to ship, including the FCC and EU AI Act rules that now apply 190+ resources, each tagged by level, commercial sources labeled. There's a 5-week plan at the end. For those who've shipped voice agents: what bit you that this path wouldn't have prepared you for? I want the production section to hold fewer surprises.
Original Article

Similar Articles