Tag
Red Hat's AI blog series part 3 details how llm-d routes model inference traffic on Amazon EKS within their managed Kubernetes platform, using Kubernetes resources and Envoy integration for real-time decisions.
Engineer Vasilios Syrakis, who built core infrastructure for Atlassian (Jira, Confluence, Bitbucket) and was laid off, published a 38-minute technical breakdown of the systems he designed, including Envoy proxies, Rust auth containers, and centralized edge architecture.