SK hynix, In Collaboration With SanDisk, Unveils The New High Bandwidth Flash (HBF) Standard, Helping To Resolve AI Inference Bottlenecks, Targeting Up To 3TB/s Bandwidth

Reddit r/LocalLLaMA News

Summary

SK hynix and SanDisk unveiled the High Bandwidth Flash (HBF) standard to bridge the performance gap between HBM memory and SSDs, targeting up to 3TB/s bandwidth and 512GB capacity to speed AI inference.

No content available
Original Article
View Cached Full Text

Cached at: 08/04/26, 02:08 PM

# SK hynix, In Collaboration With SanDisk, Unveils The New High Bandwidth Flash (HBF) Standard, Helping To Resolve AI Inference Bottlenecks, Targeting Up To 3TB/s Bandwidth Source: [https://wccftech.com/sk-hynix-sandisk-high-bandwidth-flash-hbf-standard-3tbs/](https://wccftech.com/sk-hynix-sandisk-high-bandwidth-flash-hbf-standard-3tbs/) As AI accelerators face severe performance disparity between High Bandwidth Memory \(HBM\) and SSDs, SK hynix and SanDisk have collectively introduced a solution that aims to resolve the performance gap with a new standard called High Bandwidth Flash \(HBF\)\. Both memory manufacturers aim to create an ecosystem where various enterprises can develop compatible products\. ## HBF specifications allow for up to 512GB in a single configuration that stacks NAND dies in eight or 16 layers In a nutshell, HBF possesses attributes that allow it to be positioned between HBM and enterprise SSDs\. Similar to HBM, HBF relies on multiple memory dies that have been stacked together, but instead of DRAM, it utilizes NAND flash to increase storage capacity\. Its primary role will be to complement capacity limits rather than outright replace HBM\. LLMs can be processed through HBM, which is immediately required for computing, with HBF storing data in a larger capacity\. SK hynix’s and SanDisk’s latest specifications allow for HBF to go as high as 512GB, with bandwidth ranging from 0\.4TB/s to 3TB/s\. To understand how the technology will benefit AI inference performance, assume that there’s an AI model with 500 billion parameters, and if each gigabyte can house a billion parameters, that’ll come to 500GB\. Since it’s not cost\-effective to store the entire model in HBM, companies can leverage HBF to store these AI models\. High Bandwidth Flash also supports the UCIe \(Universal Chiplet Interconnect Express\) specification, allowing HBF to connect to various CPUs and GPUs to introduce an entire flexibility layer\. Kim Chun\-sung, head of solution development at SK hynix, has said that the company “will expand the boundaries between memory and storage and contribute to building new architectures that enhance overall system efficiency\.” As SK hynix and SanDisk make efforts to popularize the HBF standard, Samsung is already establishing a healthy relationship with the likes of NVIDIA by developing and mass\-producing CMX solutions\. Through the manufacturing of its[V10 and V11 NAND flash](https://wccftech.com/nvidia-ai-gpus-face-data-bottleneck-will-require-samsung-v10-nand-for-cmx-storage/), which can reach up to 500 stacked layers, the Korean giant will target ultra\-fast storage requirements for AI servers wanting to quickly access data to increase GPU offloading, leading to better AI inference\. ![](https://cdn.wccftech.com/files/placeholder-mobile.png) ![](https://cdn.wccftech.com/files/placeholder-desktop.png) Which standard will pick up the pace? It looks like we’ll find out in the coming months\. News Source:[SK hynix](https://news.skhynix.com/en/hbf-at-fms-2026/) [![Omar Sohail Photo](https://cdn.wccftech.com/wp-content/uploads/2016/09/Omar.jpg)](https://wccftech.com/author/omarsohail/) **About the[author](https://wccftech.com/author/omarsohail/):**Omar Sohail is a reporter and analyst for Wccftech's[mobile](https://wccftech.com/topic/gadgets/)section, specializing in the technology and business of the mobile industry\. His expertise lies in the intricate hardware supply chain, covering developments in semiconductor manufacturing, chip lithography, and camera sensor technology\. Follow[Wccftech on Google](https://profile.google.com/cp/Cg0vZy8xMWM3NDB2MmIyGgA)to get more of our news coverage in your feeds\.

Similar Articles

High-Bandwidth Flash offers efficient storage for model weights

Hacker News Top

IEEE Spectrum reports on High Bandwidth Flash (HBF), a new memory technology that stacks NAND flash dies using high-bandwidth memory (HBM) packaging techniques to deliver vastly higher read bandwidth for efficient storage of LLM model weights, with first products expected in about a year.

SK hynix starts mass production of 192GB SOCAMM2 for NVIDIA AI servers

Reddit r/LocalLLaMA

SK hynix has begun mass production of 192GB SOCAMM2 memory modules optimized for NVIDIA AI servers, offering more than double the bandwidth and 75% better power efficiency compared to traditional RDIMM, addressing memory bandwidth constraints in AI training workloads.

sk hynix reallocating some hbm production to dram

Reddit r/LocalLLaMA

SK hynix is delaying the transition of some HBM3E production lines to HBM4 in order to increase general-purpose DRAM output, which currently offers higher operating profit margins.

@FinanceYF5: SK hynix and NVIDIA have signed a multi-year cooperation agreement. Memory chips cannot wait for GPU design to be completed; advanced DRAM requires years of joint design, manufacturing planning, and capital investment. AI supercomputers, personal AI PCs, Jetson robot platforms. Using NVIDIA tools to create a digital twin of the chip factory, first running all tests in the virtual factory before the actual production line...

X AI KOLs Timeline

SK hynix and NVIDIA have signed a multi-year cooperation agreement covering joint design and manufacturing planning of advanced DRAM, as well as AI infrastructure (supercomputers, AI PCs, Jetson) and digital twin factory technology, marking that the AI infrastructure competition has reached the memory level.