epyc

A user seeks advice on building a budget home AI server with 32-48GB VRAM, debating between AMD RX 9060 XT and Nvidia RTX 5060 Ti GPUs, and whether to use AM5 or used EPYC platforms for local LLM inference and large MoE model offloading.

GLM 5.2 is optimized for CPU-only inference on AMD Epyc processors with 512GB RAM.