@Suhail: One day inference will be priced pennies per billion tokens.
Summary
A tweet predicting that AI inference will eventually become extremely cheap, priced at pennies per billion tokens.
Similar Articles
@rohanpaul_ai: 100% agree. That famous Stanford report already found GPT-3.5-level inference costs has already fallen 280X in under 2 …
A discussion on how rapidly falling inference costs (280X for GPT-3.5-level in under 2 years) will lead to Jevons paradox, driving far more demand for AI and making multi-agent systems ubiquitous with cheaper open-source models.
tokens too cheap to meter
The article discusses the rapid decrease in AI token costs, predicting widespread integration of LLMs into computing infrastructure and local deployment on consumer hardware within years, shifting focus to quality and access.
@levie: Agents already make up the majority of inference. This will quickly trend toward nearly all inference over the next yea…
The tweet asserts that AI agents now dominate inference traffic, with this trend expected to accelerate, leading to agents performing numerous tasks 24/7 and consuming vast amounts of tokens.
@levie: Thought provoking post by Dwarkesh. In general - as AI gets more powerful - we should expect on the margin that inferen…
A discussion on how increasing AI power may drive inference costs toward the most economically valuable tasks, but market competition may prevent extreme price hikes as predicted by Dwarkesh Patel's blog post.
Five Chinese AI labs cut token prices up to 99%
Five Chinese AI labs cut inference token prices by up to 99% in a price war, making frontier inference nearly free and shifting the competitive advantage from models to distribution and tooling.