Tag
This tweet discusses the convergence of ML research on attention-based, matmul-optimized algorithms due to hardware constraints, drawing on the 'hardware lottery' concept and noting OpenAI's 9-month chip tape-out as a potential sign of hardware-research co-design.
This paper proposes DxPTA, a novel design space exploration methodology for efficient HW/SW co-design of photonic transformer accelerators that meet area, power, energy, and latency constraints. It achieves up to 15.2x faster searching time than exhaustive approaches, enabling efficient PTA designs for diverse transformer models.
This paper proposes a model-native computing architecture, envisioning future system design through the lens of computer architecture.
The author notes that 'thought to text' is a promising field currently being explored by many teams, emphasizing the importance of hardware-software co-design for successful implementation.