In late June, AI hardware saw massive advancements with custom chips transitioning from concepts to actual products. OpenAI, Etched, Amazon, and SambaNova led these significant developments, marking a pivotal shift in the industry. These innovations promise to enhance AI processing capabilities and efficiency.

The Hardware Coup: Why AI Hardware Just Changed Forever

The AI hardware world just went through an incredibly busy two weeks. In late June, custom chips went from ideas on a page to working physical hardware. OpenAI, Etched, Amazon, and SambaNova all made massive moves at the exact same time.

To understand why, think of general graphics processors (GPUs) as world-class generalist chefs. They can cook any dish, but they spend a lot of time cleaning up, reading recipes, and finding ingredients. Custom chips (called ASICs) are like specialized sushi chefs who only slice tuna. They do just one job, but they do it incredibly fast with zero wasted effort.

In late June, the industry decided it was time to bring in the sushi chefs.

Inside the June Silicon Wave

The velocity of this hardware wave is unprecedented. Four major players moved almost simultaneously:

• OpenAI’s “Jalapeño”: Partnering with Broadcom and Celestica, OpenAI built its first custom chip in just nine months. Early test samples are already running internal machine learning workloads in the lab. They are planning to deploy these custom chips at a massive 10-gigawatt scale by 2029.

OpenAI@OpenAI·Jun 24We’ve designed and built our first AI chip: Jalapeño.

Designed from the ground up by OpenAI and brought to production with @Broadcom, Jalapeño is purpose-built for the LLM workloads powering ChatGPT, Codex, the API, and future agentic products.

Chips are foundational to the AIShow more1.4K3.7K22K6.9M

• Etched’s “Sohu”: This startup came out of stealth with a TSMC 4nm chip designed purely for transformer models. They skipped all the usual general-purpose parts to focus only on AI math. They reached first-pass silicon success, raised $800 million, and booked over $1 billion in forward contracts. Etched claims their 8-chip server can run Meta’s Llama 70B model at 500,000 tokens/s! (while this is a self-reported claim that has not been independently verified yet) This shows how fast custom chips can be.

Etched@Etched·Jun 30We’re coming out of stealth.

We’ve built our first racks after a successful A0 tapeout, $1B+ in customer contracts, and $800m raised.

Early customer tests show us achieving SOTA throughput, latency, and power efficiency on inference workloads.

Our first racks ship this summer.6071.4K9.2K5.8M

• Amazon’s Trainium: For over 10 years, Amazon kept its custom chips strictly inside its own cloud. Now, they are in early talks to sell their directly to other data centers. This is a massive shift that challenges Nvidia’s crown.

• SambaNova’s SN50: This startup launched its fifth-generation AI chip aimed at making enterprise AI cheaper and easier to run. Their system can run in standard, air-cooled data centers so companies do not have to rebuild their facilities. SambaNova is looking to raise up to $1 billion.

The Information@theinformation·Jun 25SambaNova is set to raise up to $1 billion at a $10 billion valuation, a fivefold jump from four months ago.

The Intel-backed chip startup is pitching its inference chips as a lower-cost complement to Nvidia’s GPUs.

Read more:Intel-Backed AI Chip Firm SambaNova to Quintuple Valuation to $10 BillionFrom theinformation.com9226.4K

Rethinking the “Moat”

This wave of custom hardware has venture capital rethinking what makes an AI company defensible. For years, investors poured money into software startups that optimize models to run on generic GPUs. But as giant tech companies build custom chips that hardwire these optimizations directly into the silicon, those software-only moats are getting squeezed.

But this does not mean the infrastructure layer is dead. As Tunguz says, moats do not always have to be there on day one. While hardware startups usually need a massive technical lead to start, enduring moats can actually be earned over time through relentless execution, branding, and distribution. He points for example to Salesforce, which won the cloud CRM market over technically superior rivals simply because they executed and scaled better over ten years.

Tomasz Tunguz@ttunguz·Jun 27What is your moat?

Every founder gets the question on slide three. Most answer with technical differentiation. At the application layer, that answer dissolves in a year.

What if the moat is earned? 75174K

The New Bottom Line: Hardware Dictates the Game

The AI race is no longer just about who can write the best algorithms. Software is quickly becoming a cheap commodity. The real, defining advantages of the next decade are physical: designing custom silicon, securing power grids, and building efficient hardware. The players who win the physical layer will control the future of AI.