AMD future GPU offerings. Some interesting offerings for a LLM build. What type of LLM rig would you build with these?
Summary
Discussion about upcoming AMD GPU offerings and their potential for building an LLM rig, asking the community for build suggestions.
Similar Articles
Do people building local LLM rigs track RTX Ada/workstation card prices, or just consumer cards like the 5090?
A discussion about whether builders of local LLM rigs monitor pricing on workstation GPUs like the RTX 6000 Ada or primarily focus on consumer cards like the RTX 5090, and whether dedicated tracking tools exist for these infrequent, high-stakes purchases.
Don’t bite me for that question please…
A user asks how people are earning money with local LLM setups, given the high cost of GPU rigs, and explores potential career opportunities in hardware.
AMD to release slottable GPU
AMD is set to release new slottable PCIe-based Instinct GPUs aimed at the enterprise AI market, offering a potential new hardware option for local LLM deployment.
LLM planner - pick a rig for your use-case/model/budget, or pick models for your rig. 60+ builds, 50+ models, 130+ cited t/s sources, 150+ reviewer YouTube videos, idle+active watts, multi-region prices, regular updates.
A comprehensive web tool and public dataset that helps users choose the right hardware for running LLMs, featuring 60+ builds, 50+ models, performance benchmarks, and reviewer videos, with two-way matching between models and hardware.
Modded RTX 4090 48GB vs Radeon AI Pro R9700 vs Arc Pro B70 for local coding LLMs?
A user seeks advice on choosing between a modded RTX 4090 48GB, dual AMD Radeon AI Pro R9700, or dual Intel Arc Pro B70 for running local coding LLMs, highlighting trade-offs in price, VRAM, software ecosystem, and inference speed.