Tag
Basalt 0.5.5 adds support for Thinking Machines' Inkling 2 Mini MoE model, running it on a single RTX 5090 at up to 613 tok/s decode and ~14K tok/s prefill with NVFP4 quants, far outpacing llama.cpp's ~95 tok/s decode while keeping near-lossless quality (KLD ~0.003).
A US-based GPU repair technician claims that NVIDIA RTX 5090 variants with 64GB and 96GB of VRAM exist, suggesting potential pro-grade or workstation versions of the Blackwell consumer card.
A near-zero-coding user shares how they built their own invoicing desktop app entirely via vibe coding, using Qwen 3.8 27B running locally in LM Studio through Open Code v2.0 on an RTX 5090, saving $100/year on subscription software.
A tweet speculates about NVIDIA decommissioning the RTX 5090, quoting a claim that 64GB and 96GB versions of the RTX 5090 have been confirmed.
A detailed benchmark shows QEngine 1.3.1 (compiled for RTX 5090s) is the fastest Qwen3.8-Flash-Next engine for single-stream decode, ~1.4-1.9x faster than Strata and ~3x faster than tuned vLLM, with a KV-in-RAM mode that dramatically improves warm returns to idle conversations.
The article discusses why NVIDIA RTX 5090 GPUs have surged in price to around $10,000, likely driven by export restrictions and AI demand.
A repair shop reported receiving eight Nvidia GeForce RTX 5090 and RTX 4090 graphics cards with melted 16-pin power connectors within just two days, highlighting recurring durability issues with the high-power connector design.
A user reports GPU hangs with NVIDIA Xid 8 on an RTX 5090 Laptop GPU under Linux when running local LLMs, pointing to a llama.cpp issue where disabling CUDA graphs (GGML_CUDA_DISABLE_GRAPHS=1) serves as a performance-sapping workaround with no fix yet.
两托盘价值约47万美元的ZOTAC RTX 5090显卡在巴西机场神秘失踪,警方正在调查这起涉及高端GPU的大宗盗窃案。
NVIDIA 官方證實 GeForce RTX 5090 並未停產,將繼續出貨,以澄清先前的停產傳聞。
RTX 5090 gaming GPUs are spiking to around $5,000 as AI companies purchase them in bulk by the pallet, driving consumer card prices skyward.
A user shows that a locally-run, IQ3_S-quantized Qwen3.8-Flash-Next served via Strata and driven by the pi harness on an RTX 5090 matched (and slightly beat in speed) Claude Code Opus 5.5 on the AirBench everyday-tasks benchmark, with full reproduction steps.
Nvidia据报已停止GeForce RTX 5090的生产,转而将产能分配给AI数据中心和专业GPU,预计供应短缺将推高价格,RTX 5080 24GB版本或将取代成为新的游戏旗舰。
NVIDIA reportedly discontinuing the RTX 5090, with GB202 GPUs being redirected to the professional RTX PRO series instead of consumer cards.
MegaCapybara 是一个针对 NVIDIA RTX 5090 优化的开源 LLM 推理引擎,支持 Qwen3.8-27B,单智能体可达 500+ tokens/s,多智能体并发最高 2000+ tokens/s,具备投机解码、共享上下文池和智能 VRAM/RAM/磁盘缓存管理。
Micro Center reportedly now requires RTX 5090 buyers to sign a purchaser declaration form including a 'no export' pledge and ID verification, in an effort to curb GPU sales to banned regions like China, though analysts doubt it will stop black-market smuggling.
Strata runs Qwen3.8-Flash-Next at IQ3_S quantization on a power-limited RTX 5090 with 96GB of DDR5-6400, achieving 150-200 tok/s decode and 5-6k prefill with a 128k-token context (8-bit).
The Nvidia RTX 5090 GPU has vanished from US online retail, with third-party sellers demanding up to $9,500, driven by AI demand and raising scam risks.
A China-modified Nvidia RTX 5090 with 96GB of VRAM is available on Alibaba for under $4,000, offering three times more memory at 65% of the original cost.
The author achieved performance parity between four 2017 Tesla V100 GPUs and a modern RTX 5090 when running the Qwen 3.8 model with NVFP4 precision, using custom software optimizations like the QPN kernel for efficient inference.