Tag
Amazon is allegedly canceling GPU and compute hardware orders and, in some cases, closing customer accounts, with Epic's Tim Sweeney among those affected. It's unclear whether the cancellations stem from a glitch or an anti-scalper policy amid high demand for AI hardware.
A lawyer and PLI Labs founder publishes full benchmark data for running DeepSeek-V4.1-Flash-1017 (2.75 bpw EXL3) across two DGX Sparks with a 3090 box handling RDMA-served tables and a speculative drafter, hitting 2,600+ tok/s prefill to 256K context and 322 tok/s structured output. All code, launch scripts, and raw JSON are released publicly, with the author openly noting where his build loses to competing 2x Spark setups.
@NVIDIARTXSpark shares three techniques to accelerate Mixture-of-Experts (MoE) inference on the NVIDIA DGX Spark, covering optimized kernels, FP8 quantization, and multi-token prediction to boost tokens per second.
NVIDIA 的这篇技术博客介绍了在 DGX Spark 上加速 Ling-3.0-flash MoE 模型推理的三种优化技术:Humming MXFP4 MoE 内核、LM head 的在线 FP8 量化,以及基于 NEXTN 的多 token 预测投机解码,并分析了组合配置下的集成问题。
作者分享使用 DeepSeek V4.1 Flash(EXL3 2.9 bpw,2x DGX Spark,TP2)作为实现代理、配合独立审查代理开发真实功能的实践经验,指出其报告有时会超出实际证据。
A user loaded the 560B-parameter Ling 3.1 Flash (25B active) MoE model across four DGX Sparks using llama.cpp RPC with Atomic Chat's Q4 GGUF build, since no official FP4 vLLM build was available. Performance comparisons against Ling 3.0 Flash 124B are still pending.
Ahmad 分享了如何通过 Mikrotik CRS804-4DDQ 1.6Tbps 交换机,将 4 条 400G QSFP-DD 拆分为 2x200G QSFP56,连接 8 台配备 ConnectX-7 的 DGX Spark,实现 1.6Tbps 全速互联的集群方案。
A short tweet asking for recommendations on the best way to connect four NVIDIA DGX Spark units without using a network switch, likely for an evaluation setup.
用户提到6月购买的GPU和DGX Spark价格至少上涨了1.5倍,并指出本地AI加速的性能数据很明确。
一位用户分享了购买两台 Nvidia DGX Spark(约6100美元/台)的经历,用于学习和编程工作流,并询问 GLM 5.3 flash 的本地部署配方以及 Nvidia 论坛是否是获取相关资讯的最佳渠道。
A head-to-head comparison of three local models—GLM 5.3 Flash, DeepSeek V4.1, and Qwen 3.8 Flash Next—each generating a cinematic 3D Three.js spiral galaxy HTML file on DGX Sparks, with stats on tokens, generation time, throughput, and fixes needed.
A Reddit r/LocalLLaMA poster weighs whether to spend ~$14k on local hardware (Mac Studio M5 Ultra with 512GB unified memory vs 2x Nvidia DGX Sparks) to run large models for agentic coding, versus continuing to pay $500+/month in cloud API bills and suffering rate limits.
A dual-DGX-Spark user reports that a new GLM 5.3 Flash recipe delivers a 50-90% decode speed boost, making it faster than DeepSeek v4.0 Flash while offering better reasoning quality on local hardware.
A developer showcases a fully local parkour simulation built over the weekend using GLM 5.3 Flash running on 2x DGX Sparks with a vLLM TP2 recipe, reporting ~1500 t/s prefill and ~40 t/s decode at 100k context, and praising the model's coding, vision, and 3D understanding. He shares the vLLM NVFP4 configuration repo for others to reproduce the setup.
A developer recounts scaling their personal local-AI setup from a single RTX 3090 to a 16+ DGX Spark (GB10) cluster spanning two houses, enabling 300k-context inference of models like Kimi K3 (2.8T params) and MiMo 2.5 Pro entirely on-premises without commercial model subscriptions.
A tweet commenting on why NVIDIA DGX Spark prices are rising, linking to an external resource on the topic.
A user shares spending $60,000 on 12 DGX Sparks to run near-frontier AI locally, reacting to news that NVIDIA has released a new 64GB DGX Spark at a higher price across all models.
NVIDIA is introducing a 64GB configuration of the DGX Spark personal AI supercomputer, sold through partners like Dell, HP, and ASUS, with clustering support via NVIDIA Sync to pool memory up to 128GB for running models up to 200B parameters locally.
A buyer reports that NVIDIA DGX Spark units are hard to find and that prices appear to have jumped roughly $2,000 in a week, with local Micro Center stock vanishing overnight, raising questions about supply allocation.
A head-to-head benchmark of two community inference stacks running the 320B GLM-5.3-Flash on a pair of NVIDIA DGX Sparks, comparing Entrpi's EXL3 setup against TensorFold with DFlash2 drafters across prose, code, and prefill workloads.