rtx-5090

Tag

Cards List
#rtx-5090

Basalt: Inkling 2 Mini on one 5090 at up to 613 tok/s decode and 14.100 tok/s prefill (NVFP4)

Reddit r/LocalLLaMA ↗ · 20h ago

Basalt 0.5.5 adds support for Thinking Machines' Inkling 2 Mini MoE model, running it on a single RTX 5090 at up to 613 tok/s decode and ~14K tok/s prefill with NVFP4 quants, far outpacing llama.cpp's ~95 tok/s decode while keeping near-lossless quality (KLD ~0.003).

0 favorites 0 likes
#rtx-5090

RTX 5090 with 64GB and 96GB VRAM 'confirmed' by US GPU repair tech

Reddit r/LocalLLaMA ↗ · 2026-11-03

A US-based GPU repair technician claims that NVIDIA RTX 5090 variants with 64GB and 96GB of VRAM exist, suggesting potential pro-grade or workstation versions of the Blackwell consumer card.

0 favorites 0 likes
#rtx-5090

😃Made My Own Invoicing Dekstop App With Qwen 3.8 27B+OpenCode+LM Studio On RTX 5090..Saved Me $100 a Year I Was Paying

Reddit r/LocalLLaMA ↗ · 2026-11-02

A near-zero-coding user shares how they built their own invoicing desktop app entirely via vibe coding, using Qwen 3.8 27B running locally in LM Studio through Open Code v2.0 on an RTX 5090, saving $100/year on subscription software.

0 favorites 0 likes
#rtx-5090

@TheAhmadOsman: WOW, I wonder if that is why NVIDIA decommissioned the RTX 5090

X AI KOLs Following ↗ · 2026-10-31 Cached

A tweet speculates about NVIDIA decommissioning the RTX 5090, quoting a claim that 64GB and 96GB versions of the RTX 5090 have been confirmed.

0 favorites 0 likes
#rtx-5090

Qwen3.8-Flash-Next on 2x RTX 5090 with 504 tok/s decode: QEngine 1.3.1 decodes ~1.5-1.9x faster than the next-best engine I've tried (numbers, caveats, and what still bites)

Reddit r/LocalLLaMA ↗ · 2026-10-31

A detailed benchmark shows QEngine 1.3.1 (compiled for RTX 5090s) is the fastest Qwen3.8-Flash-Next engine for single-stream decode, ~1.4-1.9x faster than Strata and ~3x faster than tuned vLLM, with a KV-in-RAM mode that dramatically improves warm returns to idle conversations.

0 favorites 0 likes
#rtx-5090

The reason why 5090's are $10k now...

Reddit r/LocalLLaMA ↗ · 2026-10-27

The article discusses why NVIDIA RTX 5090 GPUs have surged in price to around $10,000, likely driven by export restrictions and AI demand.

0 favorites 0 likes
#rtx-5090

Repair shop receives eight GeForce RTX 5090 and RTX 4090 cards with melted 16-pin connectors in two days

Reddit r/LocalLLaMA ↗ · 2026-10-22

A repair shop reported receiving eight Nvidia GeForce RTX 5090 and RTX 4090 graphics cards with melted 16-pin power connectors within just two days, highlighting recurring durability issues with the high-power connector design.

0 favorites 0 likes
#rtx-5090

RTX 5090 Laptop on Linux: GPU hangs with Xid 8 — CUDA graphs problem and still no fix?

Reddit r/LocalLLaMA ↗ · 2026-10-19

A user reports GPU hangs with NVIDIA Xid 8 on an RTX 5090 Laptop GPU under Linux when running local LLMs, pointing to a llama.cpp issue where disabling CUDA graphs (GGML_CUDA_DISABLE_GRAPHS=1) serves as a performance-sapping workaround with no fix yet.

0 favorites 0 likes
#rtx-5090

Two pallets of ZOTAC RTX 5090 graphics cards worth $470,000 disappear at Brazilian airport

Reddit r/LocalLLaMA ↗ · 2026-10-18

两托盘价值约47万美元的ZOTAC RTX 5090显卡在巴西机场神秘失踪,警方正在调查这起涉及高端GPU的大宗盗窃案。

0 favorites 0 likes
#rtx-5090

Nvidia has officially confirmed that the 5090 is not discontinued and will continue shipping.

Reddit r/LocalLLaMA ↗ · 2026-10-17 Cached

NVIDIA 官方證實 GeForce RTX 5090 並未停產,將繼續出貨,以澄清先前的停產傳聞。

0 favorites 0 likes
#rtx-5090

Here’s why RTX 5090 costs $5,000: AI firms are buying gaming GPUs by the pallet

Reddit r/LocalLLaMA ↗ · 2026-10-11

RTX 5090 gaming GPUs are spiking to around $5,000 as AI companies purchase them in bulk by the pallet, driving consumer card prices skyward.

0 favorites 0 likes
#rtx-5090

Qwen3.8-Flash-Next Strata pi beat Claude-code Opus 5.5 on a 5090

Reddit r/LocalLLaMA ↗ · 2026-10-10

A user shows that a locally-run, IQ3_S-quantized Qwen3.8-Flash-Next served via Strata and driven by the pi harness on an RTX 5090 matched (and slightly beat in speed) Claude Code Opus 5.5 on the AirBench everyday-tasks benchmark, with full reproduction steps.

0 favorites 0 likes
#rtx-5090

No more RTX 5090

Reddit r/LocalLLaMA ↗ · 2026-10-10

Nvidia据报已停止GeForce RTX 5090的生产,转而将产能分配给AI数据中心和专业GPU,预计供应短缺将推高价格,RTX 5080 24GB版本或将取代成为新的游戏旗舰。

0 favorites 0 likes
#rtx-5090

NVIDIA reportedly discontinuing RTX 5090, GB202 GPUs to be reserved for RTX PRO series

Reddit r/LocalLLaMA ↗ · 2026-10-10

NVIDIA reportedly discontinuing the RTX 5090, with GB202 GPUs being redirected to the professional RTX PRO series instead of consumer cards.

0 favorites 0 likes
#rtx-5090

The fastest interference engine for RTX5090 and Qwen3.8 27B. Twice as fast as ninfer. 500+ t/s single coding, 2000+t/s up to 12 agents at the same time with 800k context. Smart VRAM-RAM-DISC Cache management, Loop Guard, Nice UI etc.

Reddit r/LocalLLaMA ↗ · 2026-10-03 Cached

MegaCapybara 是一个针对 NVIDIA RTX 5090 优化的开源 LLM 推理引擎,支持 Qwen3.8-27B,单智能体可达 500+ tokens/s,多智能体并发最高 2000+ tokens/s,具备投机解码、共享上下文池和智能 VRAM/RAM/磁盘缓存管理。

0 favorites 0 likes
#rtx-5090

Buying RTX 5090 At Micro Center Reportedly Now Requires Paperwork, Including A No-Export Declaration

Reddit r/LocalLLaMA ↗ · 2026-10-02 Cached

Micro Center reportedly now requires RTX 5090 buyers to sign a purchaser declaration form including a 'no export' pledge and ID verification, in an effort to curb GPU sales to banned regions like China, though analysts doubt it will stop black-market smuggling.

0 favorites 0 likes
#rtx-5090

Strata on a power limited 5090 and 96GB of DDR5-6400 is cranking out 150-200 tok/s decode and 5-6k prefill! Qwen3.8-Flash-Next at IQ3_S, CTX at 128k tokens (8-bit).

Reddit r/LocalLLaMA ↗ · 2026-10-02

Strata runs Qwen3.8-Flash-Next at IQ3_S quantization on a power-limited RTX 5090 with 96GB of DDR5-6400, achieving 150-200 tok/s decode and 5-6k prefill with a 128k-token context (8-bit).

0 favorites 0 likes
#rtx-5090

Nvidia's RTX 5090 vanishes from online retail in the US — third-party sellers now demand as much as $9,500 for Nvidia's fastest GPU

Reddit r/LocalLLaMA ↗ · 2026-09-14 Cached

The Nvidia RTX 5090 GPU has vanished from US online retail, with third-party sellers demanding up to $9,500, driven by AI demand and raising scam risks.

0 favorites 0 likes
#rtx-5090

nvidia rtx 5090 with 96gb of vram.

Reddit r/LocalLLaMA ↗ · 2026-09-11

A China-modified Nvidia RTX 5090 with 96GB of VRAM is available on Alibaba for under $4,000, offering three times more memory at 65% of the original cost.

0 favorites 0 likes
#rtx-5090

NVFP4 on VOLTA! Despite being built for Blackwell, I made four 2017 V100s run Qwen 3.8 NVFP4 natively and match my $6000 RTX 5090.

Reddit r/LocalLLaMA ↗ · 2026-08-19

The author achieved performance parity between four 2017 Tesla V100 GPUs and a modern RTX 5090 when running the Qwen 3.8 model with NVFP4 precision, using custom software optimizations like the QPN kernel for efficient inference.

0 favorites 0 likes
Next →
← Back to home

Submit Feedback