@tbpn: The CUDA moat is real, but probably not for long, says CEO of AI infrastructure platform Modal @bernhardsson. He says h…
Summary
The CEO of AI infrastructure platform Modal argues that while CUDA currently enjoys a strong moat, it will erode over 2-3 years as software improves to allow running CUDA code on alternative accelerators like TPUs.
View Cached Full Text
Cached at: 05/22/26, 11:46 AM
The CUDA moat is real, but probably not for long, says CEO of AI infrastructure platform Modal @bernhardsson.
He says he’s bullish on alternative accelerators over the 2-3 year timeline, even though there’s currently zero demand from his customers for TPUs, etc.
“The cost today of rewriting your software to run on those stacks is very high… But the cost is going to go down.”
“You’re going to have software that basically lets you take CUDA-compatible stuff and run it on alternative accelerators.”
Similar Articles
@CNET: From the Nvidia GTC Keynote, CEO Jensen Huang talks about the inference inflection point we're at.
NVIDIA CEO Jensen Huang highlighted an inflection point in AI inference during the GTC keynote, while Supermicro is partnering with NVIDIA to deliver turnkey 'AI Factory' infrastructure solutions built around the Blackwell platform.
@CNET: Nvidia CEO Jensen Huang talks about NVIDIA Co-Packaged Optics at GTC 2026
Supermicro and NVIDIA unveiled turnkey “AI Factory” racks at GTC 2026, offering pre-validated, rack-scale compute/storage/networking stacks to speed enterprise AI deployment.
The AI Gold Rush Just Entered Its Most Dangerous Phase
Google is aggressively challenging Nvidia’s AI chip dominance by opening its TPUs to external customers and targeting the inference market, potentially reshaping the global AI economy.
@CNET: From Nvidia GTC 2026, CEO Jensen Huang talks about investment in AI Natives
Supermicro and NVIDIA unveil turnkey “AI Factory” reference architectures combining Blackwell GPUs, certified servers, networking, storage and deployment services to let enterprises spin up cluster-scale AI infrastructure faster.
"Hardware is the only moat" - Should we buy new hardware now or wait?
The article discusses the growing importance of hardware as a competitive advantage in AI, noting that leading labs are prioritizing product competitiveness and compute scale over pure AGI research. It highlights the resulting strain on consumer GPU availability and the increasing costs for hardware upgrades.