microgpt

#microgpt

@FGuzmanAI: 56,000+ tokens/sec at just 80 MHz. I burned a full Transformer with KV cache into a custom chip. Designed gate by gate …

X AI KOLs Timeline ↗ · 2026-06-13 Cached

A custom digital chip designed gate-by-gate achieves over 56,000 tokens/sec running a Transformer with KV cache at just 80 MHz, prototyped on an FPGA.

0 favorites 0 likes

#microgpt

@VedaAI00: When Transformers Are Hardwired Into Hardware, Inference Speed Changes Orders of Magnitude. Luthira demonstrates a complete implementation of MicroGPT on an FPGA array. No GPU, no PyTorch, not even a CPU inference loop, just a pure hardware-driven Tra…

X AI KOLs Timeline ↗ · 2026-05-24 Cached

Luthira fully implements MicroGPT on an FPGA array, without GPU, PyTorch, or CPU inference loop, achieving inference speeds of 50,000+ tokens per second, demonstrating the potential of hardware-based Transformers.

0 favorites 0 likes

microgpt

@FGuzmanAI: 56,000+ tokens/sec at just 80 MHz. I burned a full Transformer with KV cache into a custom chip. Designed gate by gate …

@VedaAI00: When Transformers Are Hardwired Into Hardware, Inference Speed Changes Orders of Magnitude. Luthira demonstrates a complete implementation of MicroGPT on an FPGA array. No GPU, no PyTorch, not even a CPU inference loop, just a pure hardware-driven Tra…

Submit Feedback