gpu

用户分享使用 Strata 替换 llama.cpp 运行 Qwen 3.8 Flash Next 后，解码速度从 70-80 tk/s 提升至 150 tk/s，并顺带测试了 DeepSeek v4.1flash 2.25bit 量化在多 GPU 上的表现。

A US-based GPU repair technician claims that NVIDIA RTX 5090 variants with 64GB and 96GB of VRAM exist, suggesting potential pro-grade or workstation versions of the Blackwell consumer card.

Someone has released an open-source tool called 'gpu-unlock', claiming it can remove NVIDIA's software restrictions on GeForce graphics cards, substantially boost the computing power of the RTX 3060/3090/4090, and significantly accelerate AI workloads such as image generation, model fine-tuning, and LLM inference.

The author reports that RTX 8000 48GB prices have fallen to around $2100 while RTX 3090 prices have roughly doubled, arguing the RTX 8000 may now be the best value 'do everything' option for running large local models in VRAM for home-lab setups.

An open-source reference kit for NVIDIA V100 SXM2 pinouts and NVLink interconnects, providing 800 canonical contacts, connection tables, and KiCad starter designs for two- and four-GPU configurations as groundwork for an open carrier board.

The PyTorch Foundation project Ray announced a Special Interest Group (SIG) for Ray on Accelerators, uniting hardware vendors, cloud providers, and the Ray community around a vendor-neutral roadmap covering hardware-aware testing, topology-aware scheduling, and Ray Direct Transport.

A developer shares open-source vLLM patches and Triton kernels that run 8 coding agents with 250K-token contexts concurrently on two RTX 3090s by keeping the full int4 KV cache in system RAM and fetching only ~1% of tokens per attention step via a rank-64 key sketch, reporting ~545-790 tok/s total and 31/32 recall at 250K.

The author benchmarks Speedy against Avalon and Strata for running a Qwen3.8 model locally, finding Speedy dramatically faster: 4x faster reading, generation tok/s around 105-110, and 26-31% shorter total wall-clock time than Avalon.

Wired recommends the Lenovo LOQ 15 as the best gaming laptop under $1,500 amid memory-shortage-driven price hikes, highlighting its RTX 5060 configuration at $1,300 and an RTX 5050 deal at $999 as unmatched value against rivals.

The author shares disappointing results running Qwen3.8 Flash-Next on 2× R9700 GPUs via the Strata inference engine, finding no real-world gains over llama.cpp despite higher token throughput, and questions whether bespoke inference engines are overhyped.

A user benchmarked LLM inference on rented vast.ai servers with dual AMD EPYC 7642 (ROME) boards, large DRAM, and RTX 3090s, finding that RAM-heavy server builds deliver near-linear scaling up to 8 concurrent streams — hitting 94 tok/s at c=1 and 456 tok/s at c=8 on Qwen 3.8 Flash Next Unsloth Q8.

A tweet speculates about NVIDIA decommissioning the RTX 5090, quoting a claim that 64GB and 96GB versions of the RTX 5090 have been confirmed.

Futhark 博客介绍了一种通过利用运行时数组布局信息、置换迭代空间来加速 GPU 大块数据拷贝的优化技术，该方法基于线性内存访问描述符（LMADs），对部分程序有小幅性能提升。

A technical explainer on why LLM outputs can vary between identical requests: floating-point accumulation order changes with batch size on the GPU, causing tied tokens to flip and completions to diverge even at temperature 0. It highlights batch-invariance flags in vLLM, SGLang, and DeepSeek's DeepInfer, noting the throughput trade-offs for reproducible outputs.

A detailed benchmark shows QEngine 1.3.1 (compiled for RTX 5090s) is the fastest Qwen3.8-Flash-Next engine for single-stream decode, ~1.4-1.9x faster than Strata and ~3x faster than tuned vLLM, with a KV-in-RAM mode that dramatically improves warm returns to idle conversations.

据报导，AMD 计划在 11 月再次上调 Radeon GPU 价格，这可能进一步影响显卡市场的定价动态。

A complete Dell workstation equipped with a 96GB NVIDIA GPU may cost less than the standalone graphics card alone, highlighting shifting pricing dynamics in the high-end GPU market.

A Reddit user reports that Dell is currently selling RTX 6000 Pro Blackwell workstation GPUs bundled in Dell desktops for around $12k, and with discounts and rewards the net cost of just the GPU could drop to roughly $10k — an unusually low price amid high GPU demand.

Rohan Paul cites Epoch AI data showing total compute of AI chips in use grows 3.4x yearly, but warns that if new chip purchases slow to 2.5x growth, overall compute growth will follow.

AMD released the ROCm HRX Loom SDK v0.1, a specialized compiler and IR stack that targets AMD CPUs, GPUs, and NPUs, with support for AMDGPU HSA, SPIR-V/Vulkan, and emerging x86/WebAssembly backends.