Tag
A “Rack Spread” phenomenon is emerging: since mid-July, rental prices for high-end GPUs such as the B300/B200/H100 have risen sharply, while the average token price has fallen by 58%, reflecting rapidly growing inference demand amid persistently tight supplies of high-end computing capacity.
作者预测明年 GPU 价格将大幅下跌，理由包括数据中心建设放缓、Neoclouds 融资困难、AI 采用不及预期，以及小模型已能处理大部分请求，GB300 单机架即可承载 OpenRouter 上 DeepSeek V4.1 Flash 的全部流量。
GPU rental prices keep rising, primarily driven by exploding Token demand: since November last year, OpenRouter's Token usage has grown by approximately 27x (from about 6 trillion per week to 165 trillion), with the share processed by open-weight models rising from around 28% to 72%.
An analysis of GPU rental prices on Vast.ai reveals that pricing for multi-GPU configurations deviates significantly from per-GPU-hour headline rates due to supply constraints, with larger clusters often being unavailable or more expensive.