cost-latency

AI tasks become commodities once models exceed maximum necessary intelligence, shifting competition to cost and infrastructure, but frontier labs can thrive by creating valuable new markets before commoditization.

Claude Opus 4.8 allows adding system instructions mid-conversation without breaking the prompt cache, reducing cost and latency for API requests.