Robustness Evaluation of GPU Cloud Pricing Benchmarks under Incomplete Observations: A Controlled Missingness Study
Summary
An arXiv paper evaluating the robustness of GPU cloud pricing benchmarks when observations are incomplete, using a controlled missingness study to assess how gaps in data affect benchmark reliability.
View Cached Full Text
Cached at: 11/16/26, 08:29 AM
# Robustness Evaluation of GPU Cloud Pricing Benchmarks under Incomplete Observations: A Controlled Missingness Study Source: [https://arxiv.org/abs/2611.17796](https://arxiv.org/abs/2611.17796) Bibliographic Tools ## Bibliographic and Citation Tools Bibliographic Explorer Toggle Code, Data, Media ## Code, Data and Media Associated with this Article Demos ## Demos Related Papers ## Recommenders and Search Tools About arXivLabs ## arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website\. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy\. arXiv is committed to these values and only works with partners that adhere to them\. Have an idea for a project that will add value for arXiv's community?[**Learn more about arXivLabs**](https://info.arxiv.org/labs/index.html)\.
Similar Articles
The Price of Anarchy in Disaggregated Inference
This paper presents a game-theoretic analysis of disaggregated inference architectures that separate prefill and decode phases across GPU pools, characterizing how GPU saturation affects performance. The authors propose an adaptive controller that detects saturation transitions and adjusts routing parameters, reducing the Price of Anarchy significantly in experiments on NVIDIA B200 clusters.
GPU Compass – open-source, real-time GPU pricing across 20+ clouds [P]
SkyPilot team open-sources a continuously updated catalog that tracks on-demand and spot pricing for 50 GPU models across 20+ clouds, now browsable online.
The 'storage tax' on cloud GPUs for short LLM runs is brutal. What's your workflow?
User seeks advice on cost-effective cloud GPU workflows for short LLM testing sessions, highlighting storage fees as a key pain point when preserving environments between runs.
Gaming Without an Attacker: Benchmark Fingerprinting in LLM-Driven Search Under Selection Pressure
This paper examines how LLM-driven evolutionary optimization of GPU kernels can fingerprint evaluation configurations, causing 30% of in-distribution wins to fail on held-out settings. It offers a taxonomy of failure modes and design guidance for robust benchmarking under strategic optimization.
A GPU-Hour Isn't a Commodity If You Need Four of Them (6 minute read)
An analysis of GPU rental prices on Vast.ai reveals that pricing for multi-GPU configurations deviates significantly from per-GPU-hour headline rates due to supply constraints, with larger clusters often being unavailable or more expensive.