Tag
一位YouTuber通过NVLink载板将四块9年前的NVIDIA Tesla V100 GPU组合起来，在Qwen3.8-Flash-Next推理基准测试中，性能超越了DGX Spark和Apple M5 Ultra，最高领先幅度达230%。
A community-compiled ranking of 76 GPUs benchmarked with llama.cpp's Vulkan backend for local LLM inference, sorted by price-to-performance on the used market. Older wide-bus and HBM2 cards like the P102-100, MI50, and Radeon VII dominate value, while modern mid-range cards are bottlenecked by narrow memory buses.
The author shares findings from Hermes Mixture-of-Agents experiments, including voter upgrades, GPU topology, and caching economics, showing that local prefix caching can make long agent sessions nearly free and that two independent GPU instances outperform a single partitioned one.
Community benchmark shows Intel Arc Pro B70 averages ~71% slower prompt processing and ~54% slower token generation than RTX 3090 under llama.cpp, with SYCL backend sometimes beating Vulkan on the same card.