rtx-3090

Tag

Cards List
#rtx-3090

Amazing free 3090 speedup hack, verified works 15% PP, 5% TG for free

Reddit r/LocalLLaMA ↗ · 2026-10-21 Cached

gpu-unlock 1.0.0 发布候选版是一个 Linux 内核模块,通过在 NVIDIA 驱动绑定前解锁 RTX 3090 的 BF16 全速档位,免费实现约 15% 的 prompt processing 与 5% 的 token generation 提速,无需修改驱动或 UEFI。

0 favorites 0 likes
#rtx-3090

I built a cheap dual 3090 rig from used parts, but why isn't it much faster?

Reddit r/LocalLLaMA ↗ · 2026-10-14

一位开发者分享了他用二手零件组装的双 RTX 3090 本地 LLM 主机,并询问为何多 GPU 推理性能提升不及预期,以及如何定位瓶颈和优化配置。

0 favorites 0 likes
#rtx-3090

PSA for 3090 FE owners: Running LLMs overheats your VRAM

Reddit r/LocalLLaMA ↗ · 2026-10-13

RTX 3090 Founders Edition owners running local LLMs may be cooking their VRAM: benchmarks show stock fan/power curves let GDDR6X hit 112°C within seconds of token generation, far above the 96°C continuous rating. The poster recommends capping the card at 270W with fans at 100% (or 240W at 70% fan) at roughly a 30% throughput cost, and notes undervolting doesn't help because Nvidia only applies clock offsets above 300W.

0 favorites 0 likes
#rtx-3090

@loktar00: Have you always just set your 3090s between 210 and 240 and walked away? Turns out you can drop them lower and save you…

X AI KOLs Following ↗ · 2026-09-30 Cached

User @loktar00 shares that RTX 3090s can be run at much lower power limits (down to ~120W) than the usual 210-240W range, saving significant heat and power during inference workloads.

0 favorites 0 likes
#rtx-3090

Just bought a second 3090 but now I don't see the benefits right now.

Reddit r/LocalLLaMA ↗ · 2026-09-26

A user with a local AI server running one RTX 3090 asks for advice on utilizing a second card effectively as a single user.

0 favorites 0 likes
#rtx-3090

@TheAhmadOsman: It is July 2023, Llama 2 70B just came out, and I wanted to play with it locally so I built this thing 8x RTX 3090s, Ep…

X AI KOLs Timeline ↗ · 2026-09-21 Cached

In July 2023, the user built a high-end computer with 8x RTX 3090s and an Epyc 7004 CPU to run Llama 2 70B locally, expressing confidence in the future of open-source AI.

0 favorites 0 likes
#rtx-3090

The bear can dance: Qwen 3.8 27B on one 3090 for 3 weeks

Reddit r/LocalLLaMA ↗ · 2026-09-20

An experiment demonstrated that a quantized Qwen 3.8 27B model, running locally on a single RTX 3090 GPU, autonomously pursued optimizing CUDA inference for over three weeks, producing functional kernels and benchmarks while maintaining coherent long-term goal-following.

0 favorites 0 likes
#rtx-3090

Just me or is this kinda... magical?

Reddit r/artificial ↗ · 2026-09-17

A user runs a local LLM on an RTX 3090 to create a basic FPS zombie game and plans to improve its graphics overnight.

0 favorites 0 likes
#rtx-3090

Decided to build a game, and test the ceiling of Qwen3.8 27b

Reddit r/LocalLLaMA ↗ · 2026-09-14

A user built a game to test the performance limits of the Qwen3.8 27b AI model using an overclocked RTX 3090, and plans to release it as open-source on GitHub for community contribution.

0 favorites 0 likes
#rtx-3090

2×RTX 3090 + EPYC box running qwen3.8-flash-next at ~38 tok/s

Reddit r/LocalLLaMA ↗ · 2026-09-12

The user describes a hardware configuration with dual RTX 3090 GPUs and an AMD EPYC CPU for running the Qwen3-Flash-Next model using llama.cpp, achieving 38 tokens per second in single-stream inference, and seeks advice on whether to add a third GPU or upgrade the CPU to improve performance, especially for running multiple parallel agents.

0 favorites 0 likes
#rtx-3090

DeepSeek-V4-Flash-Vision-Exp (285B MoE) on 10-12x RTX 3090 — spec decoding, vision

Reddit r/LocalLLaMA ↗ · 2026-09-09

Running the DeepSeek-V4-Flash-Vision-Exp 285B MoE model on 10-12x RTX 3090 GPUs achieves over 60-120 tok/s decode speeds with vision and tool support, fully documented for reproducibility.

0 favorites 0 likes
#rtx-3090

Given how common RTX 3090 use is for LLMs, why don't we see more INT8 W8A8 models ?

Reddit r/LocalLLaMA ↗ · 2026-09-01

The post questions why INT8 W8A8 models are not more common among LLM users despite the RTX 3090's native INT8 support, based on hardware usage data from Hugging Face.

0 favorites 0 likes
#rtx-3090

qwen38-27b-rtx3090 (https://github.com/syv-ai/qwen38-27b-rtx3090) is extremely good with deepseek harness.

Reddit r/LocalLLaMA ↗ · 2026-08-24

Running the Qwen 3.8 27b model with vision on a single RTX 3090 GPU enables 150k context length, and integration with DeepSeek harness allows for plugin development, though a search engine plugin caused a system crash.

0 favorites 0 likes
#rtx-3090

@malikwas1f: 308 tok/s aggregate on 2× RTX 3090 — no NVLink Qwen3.8-27B on vLLM, 32 concurrent streams. Enough to feed a whole swarm…

X AI KOLs Timeline ↗ · 2026-08-23 Cached

A performance report and guide for running the Qwen3.8-27B model on dual RTX 3090 GPUs using vLLM, achieving 308 tokens per second with 32 concurrent streams, with a GitHub repository for local deployment configurations.

0 favorites 0 likes
#rtx-3090

@TeksEdge: A localmaxxer hit ~381 tok/s on a SINGLE RTX 3090 with Qwen3.8-27B. This developer has turned a 24GB RTX 3090 into a mo…

X AI KOLs Timeline ↗ · 2026-08-21 Cached

A developer achieved up to 381 tok/s inference speed on a single RTX 3090 with the Qwen3.8-27B model using optimized techniques like DFlash2 and prefix caching, particularly effective for document-based tasks like RAG and coding assistants.

0 favorites 0 likes
#rtx-3090

@0xSero: Just 3090s with Qwen3.8-27B I'm extremely satisfied with it, feels different enough from glm and very compatible It mad…

X AI KOLs Timeline ↗ · 2026-08-18 Cached

A user shares satisfaction with using the Qwen3.8-27B AI model on RTX 3090 GPUs, comparing it favorably to GLM and describing the creation of a bossfight scene.

0 favorites 0 likes
#rtx-3090

I pushed Qwen3.8-27B to 99 tps single request and 1150 tps with a batch request on a RTX 3090

Reddit r/LocalLLaMA ↗ · 2026-08-17

The author optimized the Qwen3.8-27B model inference on an RTX 3090 GPU, achieving up to 99 tokens per second for single requests and 1150 tps with batch processing through various quantization and optimization techniques, and released the updated code on GitHub.

0 favorites 0 likes
#rtx-3090

Muse Glimmer ACTUALLY fits on a single RTX 3090

Reddit r/LocalLLaMA ↗ · 2026-08-10

User reports that Muse Glimmer, a 30B model, fits on a single RTX 3090 with full 256k context using Q4_K_XL quantization and DFlash, achieving 64-124 tok/s and perfect long-context retrieval, unlike comparable models.

0 favorites 0 likes
#rtx-3090

Dual 3090 setup: 400 pp t/s to 1600 pp t/s on Qwen 3.6 27B... with slightly lower tps.

Reddit r/LocalLLaMA ↗ · 2026-08-06

A user on a dual RTX 3090 setup discovers that llama.cpp's --split-mode tensor runs prompt processing on CPU (~400 t/s), while switching to --split-mode layer unlocks GPU prompt processing over 1600 t/s, with only a modest drop in token generation speed.

0 favorites 0 likes
#rtx-3090

Auto-fit vs tuned MoE offload: 564 → 1330 pp tok/s, unchanged decode (Qwen3.6-35B-A3B Q6 / RTX 3090)

Reddit r/LocalLLaMA ↗ · 2026-08-06

A developer benchmarks Qwen3.6-35B-A3B Q6 on an RTX 3090, showing that offloading eight MoE expert layers to CPU and increasing batch sizes improves prompt processing by 2.36× (564→1330 tok/s) with no decode speed regression, using evolutionary search to find the tuning config.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback