@zephyr_z9: Well tHBM has a huge power delivery problem U will have to route 1000s of Amps thru the HBM stack
Summary
A discussion highlights the significant power delivery problem in tHBM technology, requiring routing of thousands of Amps, and critiques Samsung's zHBM for potential melting issues due to stacking memory on hot GPUs, as revealed by HBM creator Kim Jung-ho.
View Cached Full Text
Cached at: 08/19/26, 04:37 AM
Well tHBM has a huge power delivery problem U will have to route 1000s of Amps thru the HBM stack
Fireside Alpha (@firesidealpha): HBM creator Kim Jung-ho reveals his lab’s tHBM flipped stack publicly for the first time saying Samsung’s zHBM with memory stacked on a hot GPU simply melts and is likely not the right fundamental direction
“So the idea is, let’s just put the HBM on top of the GPU. Then you
Similar Articles
Samsung Debuts zHBM Prototype, Stacking Memory Directly on AI Accelerators
Samsung unveiled zHBM and zNAND-O memory technologies at the FMS 2026 conference, designed to stack memory directly on AI accelerators for up to 8x higher performance and improved power efficiency in AI systems.
Hot Chips 2026: Samsung and HBM Base Die Opportunities
At Hot Chips 2026, Samsung presented opportunities to utilize unused area on HBM base dies after moving to a logic node, with phases including integrating memory controllers to optimize PHY area and power.
Micron's memory wall chart. Compute up ~3x every two years, HBM bandwidth under 2x
A memory tutorial at hot chips 2026 highlights the growing gap between compute performance and HBM bandwidth, with practical fixes being implemented, such as Samsung's LPDDR5x achieving 3.01x token speed on llama 3.1 8B.
Micron: HBM Requires Three Times More Wafer Area Than DDR5
Micron states that High Bandwidth Memory (HBM) requires three times more wafer area compared to DDR5 memory.
What Comes After HBM (7 minute read)
The memory industry is experiencing a supercycle due to high AI demand for HBM in Nvidia GPUs, with supply shortages expected to continue and memory manufacturers projected to achieve high profits despite cyclicality.