Are older Titan cards still viable?
Summary
A user explores the viability of older Nvidia Titan cards for running Gemma/Qwen MOE coding models, comparing memory bandwidth and cost against newer consumer cards.
Similar Articles
24+ tok/s from ~30B MoE models on an old GTX 1080 (8 GB VRAM, 128k context)
A developer demonstrates running MoE models like Qwen 3.6 35B-A3B and Gemma 4 26B-A4B at 24+ tok/s on an old GTX 1080 (8GB VRAM) with 128k context using llama.cpp with MoE offloading and TurboQuant KV cache quantization, revealing optimization tricks for Gemma's MTP speculative decoding.
Benchmarking 15 "E-Waste" GPUs with Modern Workloads
Benchmarking 15 decommissioned NVIDIA Tesla GPUs (K80, P100, V100) for modern AI workloads, showing their viability and cost-effectiveness for homelab inference setups.
Are there still any hidden gem gpu's left?
The article discusses the search for cost-effective GPU options like Tesla P40 and V100, noting that prices often increase after popular videos, and questions current feasible alternatives.
Gemma 4 QAT benchmark results (AMD 7900 XTX): faster, less VRAM, no quality loss
A user benchmarks Google's Gemma 4 QAT models on an AMD 7900 XTX, reporting up to 45% faster generation, 83% higher throughput, and significant VRAM savings (e.g., 5.7GB for the 12B QAT model) with no quality loss compared to standard weights.
@analogalok: my 8 GB VRAM gaming laptop is absolutely going to hate me for this. but I still did it. ran a 31b dense model (Gemma 4 …
User runs Gemma 4 31B dense model on 8GB VRAM gaming laptop at ~3 tokens/sec using llama.cpp with MTP speculative decoding, demonstrating feasibility of running a 31B dense model on consumer hardware and proposing agentic workflows where a fast MoE model routes to this slower dense model for hard tasks.