Tag
At Hot Chips 2026, Samsung presented their Processing-in-Memory (PIM) technology, which integrates MAC units within LPDDR5X chips to exploit high internal bandwidth for enhanced compute efficiency in AI workloads.
Samsung presented a 16 GB LPDDR5X memory package with integrated compute units at Hot Chips 2026, offering 614 GB/s internal bandwidth to significantly improve AI inference performance by overcoming memory bandwidth limitations.
Proposes RED-PIM, an algorithm-architecture co-design that reduces inter-bank data movement from O(N^2) to O(N) and shrinks attention matrices, achieving significant inference time reductions (16% to 99.99%) for transformer models.