Dual rtx 3090 build
Summary
A user shares their dual RTX 3090 build for local LLM inference and seeks advice on tool stacks for agentic work and RAG pipelines.
Similar Articles
Upgrading from 2x 3090 - what should I add? (2x A6000/5090/48GB 4090?)
A discussion about upgrading from dual RTX 3090s to alternatives like dual A6000s, RTX 5090, or 48GB RTX 4090, likely for AI/ML workloads.
@leopardracer: https://x.com/leopardracer/status/2055341758523883631
A user shares their experience setting up a dual-GPU local AI lab with RTX 4080 Super and 5060 Ti, running Qwen 3.6 models via llama.cpp and llama-swap to reduce API costs and enable unrestricted experimentation.
Modded RTX 4090 48GB vs Radeon AI Pro R9700 vs Arc Pro B70 for local coding LLMs?
A user seeks advice on choosing between a modded RTX 4090 48GB, dual AMD Radeon AI Pro R9700, or dual Intel Arc Pro B70 for running local coding LLMs, highlighting trade-offs in price, VRAM, software ecosystem, and inference speed.
@TheAhmadOsman: Gentle reminder that all you need to start with Local AI is: - 2x RTX 3090s (pick up for $700-$900 on r/hardwareswap) -…
A reminder that two RTX 3090s and open-source models like Qwen 3.6 27B or Gemma 4 31B can run powerful local AI agents, comparable to Opus 4.5, using tools like Claude Code and self-hosted SearXNG.
NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B on 2x3090s
A detailed guide on running the quantized NVIDIA-Nemotron-Labs-3-Puzzle-75B-A9B model on two RTX 3090s using vLLM with full 262K context, achieving high inference speeds without CPU offloading.