Tag
作者主张开发者应自建并控制 LLM 代理（proxy），以获得真正的 token 用量、请求日志、缓存命中等可观测性数据，而不是依赖各大模型厂商提供的无用仪表盘。
PyTorch Conference North America (Oct 20-21, San Jose) features a keynote by Priya Nagpurkar of IBM Research on IBM and Red Hat's contributions to the PyTorch ecosystem, including out-of-tree accelerator infrastructure, Spyre Accelerator enablement, and llm-d distributed inference work.
An arXiv paper presents an AI-driven framework for thermal-aware data center capacity planning that predicts temperatures in milliseconds, achieving high accuracy on unseen designs with a 10,000x speedup over high-fidelity CFD simulations, enabling real-time optimization of workload distribution and HVAC cooling for LLM-driven data centers.
A curated video-guided curriculum and comprehensive list of resources for learning ML systems and LLM infrastructure, including papers, courses, and tutorials.
This article deeply analyzes the concept of Agent Harness, which is the engineering infrastructure wrapped around an LLM, including 12 components such as orchestration loops, tool calling, memory systems, context management, etc. The article cites practices from companies like Anthropic, OpenAI, and LangChain, arguing for the critical role of the harness in production-grade AI agents.
The author introduces Computer Agents, a platform providing persistent cloud environments with file and terminal access to enhance AI agent reliability and context retention across sessions.
The author introduces Weavable, a platform layer built to address context pollution and persistence in AI agent workflows by preprocessing data from enterprise tools before passing it to LLMs.
A developer discusses limitations in current AI agent memory systems and proposes a new memory layer tool with episode storage and replay debugging, seeking community validation.
Modal Labs has released an open-source, interlinked GPU glossary that consolidates fragmented NVIDIA documentation, CUDA details, and compiler flags into a single navigable resource for engineers optimizing LLM training and inference.
A user seeks experienced guidance on building a 6× Intel Arc B70 LLM inference rig, particularly for Llama models and vLLM deployment, offering compensation for consultation.
A developer seeking recommendations on advanced AI workflow orchestration tools and patterns, including LangChain, LangGraph, and AWS Step Functions, to build more robust and future-proof systems.