Tag
A talk at Hot Chips 2026 explores High Bandwidth Flash (HBF) technology and its potential applications in machine learning, focusing on using vLLM to store model weights and KV cache in HBF for improved capacity.
SK hynix and SanDisk unveiled the High Bandwidth Flash (HBF) standard to bridge the performance gap between HBM memory and SSDs, targeting up to 3TB/s bandwidth and 512GB capacity to speed AI inference.
IEEE Spectrum reports on High Bandwidth Flash (HBF), a new memory technology that stacks NAND flash dies using high-bandwidth memory (HBM) packaging techniques to deliver vastly higher read bandwidth for efficient storage of LLM model weights, with first products expected in about a year.