Tag
Show HN: kube32 is a Kubernetes-compatible control plane and WebAssembly pod runtime for ESP32-S3 microcontrollers, letting you manage a cluster of boards with kubectl and k9s over Wi-Fi or USB serial.
Radar 是一个开源 Kubernetes UI 与 MCP 服务器,为 AI 代理(如 Claude Code、Codex、Cursor)提供集群上下文,包括按优先级排序的问题、变更时间线、日志与负责人,并支持一键调查故障工作负载以定位根因。
llm-d 是一个开源、Kubernetes 原生的分布式 LLM 推理栈,支持 vLLM、SGLang 等引擎,可在 GPU、TPU、XPU 等异构硬件上提供生产级服务,并宣称大幅提升吞吐量与降低 TTFT。
At PyTorchCon 2026, Ion Stoica traces Ray's evolution from reinforcement learning into the distributed compute layer behind modern AI workloads, highlighting topology-aware scheduling for TPU pods and Blackwell GPUs, NIXL GPU transfers, TorchFT integration, and future plans to rewrite core components in Rust and deepen Kubernetes integration.
A blog post exploring why GitOps is so effective, defining it as running everything 'as code' with declarative, versioned, continuously reconciled state, using Kubernetes tools like Argo CD and Flux as examples.
Claude Code Template v1.0 for Spring Boot 发布,包含 6 个重写的专用 agent 和 2 个新 skill,提供生产级 Spring Boot 4.x / Java 21+ 应用开发模板,涵盖 REST API、JPA、安全、测试、云原生部署和 Kubernetes 最佳实践。
A long-time systems engineer and Kubernetes skeptic shares his first-hand exploration of Kubernetes, arguing its value derives primarily from control loops and declarative desired state rather than just being another orchestration diagram.
The author discusses the shortcomings of open-source Sandbox services and proposes two core requirements: rootfs should use cloud storage to improve availability during node failures and reduce pause latency, and the /workspace file interface should be usable even when the sandbox is not started. They also emphasize building on the Kubernetes ecosystem rather than maintaining a separate cluster.
Phancy Group and RiseUnion launched ModelSphere, an open-source LLM deployment platform on GitHub under Apache 2.0, targeting production serving on mixed GPU fleets with Kubernetes, Helm, SGLang, and vLLM integration. Reception is still early, and its listed features like autoscaling and shared KV cache remain unverified project claims.
Ali's open-source OpenSandbox added a fast sandbox feature that minimizes sandbox creation latency by bypassing Kubernetes scheduling and runtime. The author finds the architecture too hacky and prefers alternatives like E2B.
Google 开源了 AX(Agent Substrate 之上的高吞吐声明式编排器),用于在集群中运行数十亿自主 AI 代理任务,提供 Task、Workspace、Model 三大原语及 ax apply/ssh/suspend/resume 等操作,Apache 2.0 协议。
Part 5 of an inference engineering series explaining how to build a GPU scheduler for ML workloads, covering first-fit bin-packing, ordering heuristics, race conditions in concurrent schedulers, and GPU-specific extensions like topology awareness and gang scheduling.
The article systematically lays out the overall architecture of a "Decoupled Brain and Hand" enterprise agent platform: the control plane (Harness) holds reasoning and session state, an elastic sandbox pool executes commands on demand, and the design revolves around four boundary governance mechanisms — control plane / execution plane decoupling, key exclusion with dynamic broker replacement at the edge, and an append-only incremental event stream.
Netflix 技术博客文章,介绍其如何在大规模训练与推理任务中检测故障 GPU 和网络、自动修复故障机器,并让长时间运行的任务在硬件故障时继续运行。文章强调了 GPU 可靠性对可用性和成本效率的重要性,并解释了为何基础健康检查不足以应对现代 ML 基础设施的需求。
QA Wolf 介绍其 E2exe 架构:将 Windows 桌面测试建模为可丢弃的「设备」,通过 Kubernetes 设备调度器在 GCE 上分配一次性 VM,并结合 Playwright/CDP、Appium 和 WebRTC 实现大规模并行的 Windows 桌面自动化测试。
NVIDIA's Run:AI AI workload and GPU orchestration platform is now available under the Apache-2.0 license as an open-source monorepo, including its control plane, cluster services, CLI, and MCP server for managing GPU resources on Kubernetes.
NVIDIA 将完整的 Run:ai 平台开源,作为 NVIDIA DSX AI Factory 平台的一部分,提供生产级 AI 工作负载与 GPU 编排能力,包括可独立采用的 KAI Scheduler、GPU Fractioning Operator、KAI Resource Management 和 Workload Map 四大组件。
PyTorch Conference North America (San Jose, Oct 20-21) will feature Carlos Costa of IBM Research and co-founder of llm-d sharing news on how the llm-d project has matured to deliver state-of-the-art performance for generative AI serving, including multi-tenant QoS and zero-downtime operations.
CostGraph 博客详解如何把 Kubernetes 节点资源整理建模为多维向量装箱问题(d 维 vector bin packing),说明为何按单一尺寸排序(first fit decreasing)会浪费容量,并介绍基于 Panigrahy et al. (2011) 几何启发式、结合真实用量 P95 与调度器硬性约束的贪心打包方案。
A discussion post comparing Kubernetes-style infrastructure primitives (pod, deployment, service) to what AI agents would need (agent, model, MCP server, sandbox), asking whether any mature frameworks exist for defining and abstracting agent infrastructure primitives, noting kagent as an early effort.