gpu

NVIDIA's RTX 5080 graphics card is now selling for nearly $2,000 at US retailers, representing an $800 price increase in just two months.

NVIDIA announced new RTX Spark thin-and-light laptops from major OEMs alongside the open-weight Nemotron 3.5 Transcribe speech model, GPU resource management tools for agents, and new game support with DLSS 4.5 and path tracing.

The article discusses why NVIDIA RTX 5090 GPUs have surged in price to around $10,000, likely driven by export restrictions and AI demand.

A user shows off a custom AI workstation built around 8x Radeon R9700 GPUs, a Threadripper 9955WX, and dual Seasonic PSUs, upgraded from 4 GPUs to run larger local models.

A developer shares ApexW, an experimental PyTorch optimizer using compact optimizer states and a Triton-based execution path, claiming ~1.5x faster optimizer steps and halved optimizer-state memory on large-tensor workloads — while openly noting regressions on many-small-tensor models and minimal end-to-end gains.

Practical notes from Session 1 of a GPU kernel engineering series, covering CUDA 13's GPU compute-capability cutoff, the driver/toolkit/PyTorch-runtime split, async GPU timing pitfalls, and fixing Nsight Compute's ERR_NVGPUCTRPERM profiler counter permissions error.

Google Gemma 声称利用 Gemini 4 Argon 在 A100 上通过 vLLM 实现了 2.85 倍推理加速，gemma-4-E2B-it 吞吐量从约 37,900 提升至 108,000+ tokens/sec，且保持 100% token parity、无质量下降。

StereoLift Live is a new product that lets Windows or Linux users with an NVIDIA GPU stream their desktop in real-time stereoscopic 3D to a Meta Quest headset over a local network.

对 Qwen3.8-Flash-Next NVFP4 模型在单张 RTX 5090 上的三个推理引擎（basalt、capy-flash、ninfer-ext）进行全 262k 上下文基准测试，basalt 在所有上下文长度和两种解码模式下均领先（prefill 8.1k-9.2k tok/s，greedy decode 176-265 tok/s），解码排名与 MTP 草稿接受率一致。

A repair shop reported receiving eight Nvidia GeForce RTX 5090 and RTX 4090 graphics cards with melted 16-pin power connectors within just two days, highlighting recurring durability issues with the high-power connector design.

A llama.cpp pull request discussion about improving strata decode performance on an AMD R9700 GPU, referencing the ggml/llama.cpp C/C++ LLM inference project.

该论文系统比较了 2:4 半结构化稀疏化与量化在 LLM 推理中的取舍，发现在仍有更低精度可用时，加入 2:4 稀疏化既更慢又更不准确；只有在达到硬件量化下限（如 FP8/NVFP4）后，2:4 稀疏化才展现出 1.3–1.7× 的线性层加速价值，且需通过重训练恢复质量。

llama.cpp PR #29887 adds an LRU MoE expert cache that exploits locality of reference, boosting Qwen3.8-Flash-Next (94GB) runs to 67.8 tok/s on an RTX 5090 (2.2x), with SGLang merging a similar 'paged experts' feature days later.

Blick Blog explains how an immediate-mode UI can pair with a tile-based rendering cache that hashes drawing commands per frame, repainting only changed regions. Benchmarks on an M3 MacBook Pro show about 20% lower combined CPU and GPU power use during a light-editing task.

A Linux kernel module hack reportedly unlocks 1.9x faster BF16 tensor math on NVIDIA RTX 3090 cards, boosting BF16 TFLOPS from 82 to 155 and cuBLAS GEMM performance, since NVIDIA ships the cards with fp32-accumulate tensor math at half rate.

Google Cloud and NVIDIA announced the general availability of A5X instances powered by NVIDIA Vera Rubin NVL72, scaling to up to 960,000 Rubin GPUs for agentic inference and large-scale reinforcement learning, with early customers including Ineffable Intelligence and WPP.

NVIDIA expands its Confidential Computing layer with Confidential Bare Metal, new platform security controls, and support across Grace Blackwell and Rubin systems, letting frontier model builders securely run sensitive workloads on third-party infrastructure while retaining control of their models and data.

The Rust compiler team announced two new groups: a GPU target notification group staffed by experts from AMD, Nvidia, and Intel to help diagnose GPU-related issues, and a Linker working area focused on integrating alternative linkers such as Wild into the compiler.

Qwen3.8-Flash-Next is released in a 1.66bpw EXL3 quantization that fits entirely within a 36GB RTX 5090 with no offloaded experts, delivering stable 200-300 t/s inference without reasoning loops.

A developer shares custom general and fused LoRA kernels for llama.cpp that restore prompt-processing throughput on Strix Halo from ~300 t/s back up to ~1400 t/s when running LoRA adapters, and invites others to help upstream the changes.