Tag
This article is a detailed guide on large language model deployment, covering key metrics such as latency, throughput, and memory usage, and illustrates how to optimize performance and choose hardware through practical cases.
A guide on disassembling the NVIDIA H200 GPU and installing liquid cooling using the EK-Pro H200 NVL water block.
This article introduces local large model hardware configurations from $2,000 to $40,000, including detailed setups from dual RTX 3090 to quad RTX PRO 6000, covering PCIe switches, GPU communication, Docker configuration, and speech-to-text.
A comprehensive guide to building a local setup for running state-of-the-art LLMs, including hardware recommendations (from $2k to $40k), PCIe switching, and Docker configurations for models like Qwen and GLM.
The author announces a new blog post on clustering three Jetson Nano Orin Supers for distributed training and inference, continuing a series to help people build small compute clusters with accessible hardware.
AgentSwarms launched an interactive, gamified blog that helps users match open-source LLMs to the right GPU by calculating VRAM requirements based on model size and quantization, turning infrastructure planning into an engaging experience.
A comprehensive guide to buying a laptop in 2026, covering use cases, budget, operating systems, processors, graphics, RAM, storage, screens, ports, and more. Updated with the latest chip news from Intel, AMD, Apple, and Qualcomm.
The author shares a synthesized buying guide for hardware suitable for running local LLMs, comparing Mac Studio, NVIDIA, and AMD options based on community feedback.