I benchmarked 15 "E-Waste" GPUs with Modern Workloads
Summary
A benchmark comparison of 15 older GPUs considered e-waste, testing their performance on modern workloads.
Similar Articles
Benchmarking 15 "E-Waste" GPUs with Modern Workloads
Benchmarking 15 decommissioned NVIDIA Tesla GPUs (K80, P100, V100) for modern AI workloads, showing their viability and cost-effectiveness for homelab inference setups.
I compared all specs of the major GPUs/machines that are being used here, because bandwidth is not everything. Some of ya'll need a reality check.
The author compares various GPUs for LLM inference, critiquing common benchmarks and emphasizing the importance of prefill performance over generation speed, offering recommendations for different budgets and use cases.
Benchmarks of 20 small LLMs on a 6GB RTX 4050
A detailed benchmark of 20 small LLMs quantized for a 6GB GPU, measuring speed and VRAM usage at various context lengths, with qualitative probing for tool-use and instruction following. The report aims to help users with modest hardware choose models for local, private automation tasks.
Are older Titan cards still viable?
A user explores the viability of older Nvidia Titan cards for running Gemma/Qwen MOE coding models, comparing memory bandwidth and cost against newer consumer cards.
Benchmarks from the latest eBay special: W6800 (modded V620)
A user benchmarks a modded AMD V620 GPU flashed with W6800 firmware and a custom blower fan for running LLMs via Vulkan and ROCm backends, comparing performance on Qwen2.5-27B at various quantization levels.