Tag
An AI agent running on NVIDIA's DGX Spark gets priority cooling treatment in a data center, highlighting infrastructure needs for AI workloads.
Successfully deployed the DeepSeek-V4-Flash-0731 model locally on a dual DGX spark GB10 system.
A user shares their experience of purchasing the MSI DGX Spark, using it to run AI models like DeepSeek V4 Flash and DeepSeek Harness, and exploring Minimax H3 and Music features.
The author observes that the Chinese AI community focuses on DeepSeek, the English AI community focuses on DGX Spark, and predicts that the two will merge.
The DGX spark community is experiencing high activity and enthusiasm.
A tweet advising owners of NVIDIA's DGX Spark to prioritize using nvfp4 for optimal performance.
An observation of Ling-3.0-flash (124B) on one DGX Spark generating 15,128 tokens in a single response with stable decode throughput around 35.6 tok/s, highlighting long-context decoding performance.
An independent benchmark by sudoingX shows the Ling-3.0-flash model runs at 38.7 tok/s on a single DGX Spark with official INT4 quantization, 2.4x faster than DeepSeek V4 Flash on the same hardware, after a correction clarifying the quants do work.
User tests Meta's Muse Glimmer 30B on a 2× DGX Spark cluster, extending context from 131K to 1M tokens with YaRN and confirming passing retrieval at 832K tokens. Reports ~3× speedup from DFlash speculative decoding and shares full config.
This post describes two configuration flags that increase the official Ling-3.0-flash INT4 inference speed from 20.8 to 38.7 tok/s on a single DGX Spark, while warning about the need for a specific vLLM fork and noting tradeoffs with long-context performance.
Ahmad Osman argues that dense models like Qwen 27B perform poorly on unified-memory systems such as NVIDIA DGX Spark, suggesting MoE models are a better fit; he claims discrete GPUs like the RTX PRO 6000 deliver far better performance for agentic workloads.
User seeks community advice on reducing VRAM usage and freeing OS RAM when serving DeepSeek-V4-Flash-0731 on two DGX Spark machines with vLLM, sharing detailed configuration and memory measurements.
Ray Fernando expresses excitement about Local Studio, an open-source interface for running AI agents on two connected DGX Sparks, similar to Codex.
A practical guide to selecting MikroTik switches (CRS504, CRS804, CRS812) for building DGX Spark clusters, including pricing and real user examples of 8x DGX Spark setups.
The author ran same-conditions tests of MiniMax H3 and LTX 2.3 Eros video generation models on DGX Spark. Results show H3 is stronger in narrative and instruction following and includes audio, while LTX is about 1.76x faster.
A 14.7-hour soak test of DeepSeek V4 Flash on an NVIDIA DGX Spark with 971 requests shows zero crashes or errors, but throughput declined 28% due to thermal throttling, while TTFT and speculative acceptance remained stable.
A user shares that they replicated running DeepSeek-V4-Flash-0731 on a DGX Spark using antirez's DwarfStar-4 setup, confirming impressive performance on a single device.
This open-source project enables Nix and NixOS on the NVIDIA DGX Spark, providing USB boot images and a NixOS module for configuring the hardware.
A user is setting up a 16-node DGX Spark cluster to run frontier open models locally, discussing networking tradeoffs between 200 and 100 Gbit/s.
A detailed strategy using VRAM as disk cache with unified memory and llama.cpp settings achieves 340 pp/s and 9.6 tg/s for Kimi K2.7 on a single DGX Spark.