Dual AMD Radeon AI Pro R9700 or dual NVIDIA or RTX 3090.

Reddit r/LocalLLaMA News

Summary

The author is building a dual GPU system for running large language models, evaluating AMD Radeon AI Pro R9700 versus NVIDIA RTX 3090 options while aiming to reduce AI subscription costs.

I’m building a dual GPU box. Originally the goal was 30b at FP8 or 70b at Q4. I planned to run two R9700’s, but I found a pair of NIB RTX 3090’s near me for $1600 each. Discount if I buy both. RTX 40/50 series are off the table. I would love an RTX PRO 6000, but that is also off the table. I currently have a Studio M1 Max with 64GB RAM and an AM4 box with a 7900 XT that powers my Hermes agent. My goal is to cancel most of my frontier subscriptions and keep only one for coding.
Original Article

Similar Articles

A very confusing report from Puget Systems

Reddit r/LocalLLaMA

This article evaluates the AI inference performance of dual AMD Radeon AI PRO R9700 GPUs, comparing them to Intel Arc Pro B70 and NVIDIA RTX 5090, highlighting cost-effectiveness and software challenges.

4xR9700, 2xMi210 or 4x4080S 32G

Reddit r/LocalLLaMA

The user is comparing GPU options like R9700, Mi210, and 4080S to achieve 128GB VRAM for running multiple AI models in parallel, considering factors like cost, performance, and compatibility.