[P] Built a portable GPU ISA after reading too many architecture manuals [P]

Reddit r/MachineLearning Tools
gpu isa portable toolchain open-source architecture

Summary

A portable GPU ISA called WAVE that compiles kernels to a common binary and translates to vendor-specific backends (Metal, PTX, HIP, SYCL), with verified results across multiple GPUs.

I’ve been reading GPU architecture docs in my free time. NVIDIA PTX, AMD ISA reference guides, Intel Xe, reverse-engineered Apple GPU stuff. Over 5,000 pages across 16 microarchitectures. After a while you notice all four vendors are doing the same 11 things with different names. So I wrote a spec that covers all of them and built a toolchain around it. It’s called WAVE. You write a kernel once, it compiles to a portable binary, then thin backends translate it to Metal, PTX, HIP, or SYCL. Same binary verified on Apple M4 Pro, NVIDIA T4, and AMD MI300X. My co-author Onyinye built PyTorch integration and got identical training results across all backends. Please star on GitHub: [https://github.com/Oabraham1/wave](https://github.com/Oabraham1/wave) Preprint: [https://arxiv.org/abs/2603.28793](https://arxiv.org/abs/2603.28793) Read full docs and how I built everything: [https://wave.ojima.me](https://wave.ojima.me) pip install wave-gpu
Original Article

Similar Articles

A hackable compiler to generate efficient fused GPU kernels for AI models [P]

Reddit r/MachineLearning

The author presents a custom, hackable ML compiler written in Python that lowers LLMs to optimized CUDA kernels through a multi-stage IR pipeline, achieving performance competitive with or superior to PyTorch on specific operations. The article details the compiler's optimization passes, lowering rules, and CLI usage for generating efficient fused GPU kernels.

FMAG: A single-instruction GPU virtual machine and toolchain

Lobsters Hottest

FMAG is a GPU virtual machine with a single instruction (fused multiply-add with guard) that eliminates thread divergence, allowing efficient interpretation of arbitrary programs per element on the GPU. It includes a toolchain and library for writing and running such programs.

I built a GPU back end for Emacs

Hacker News Top

The author describes building a GPU-based display backend for Emacs using Metal on macOS and OpenGL on Linux, improving rendering performance and enabling new effects like video playback and animated cursors, without modifying the core redisplay engine.

Home made GPU escalated quickly [video]

Hacker News Top

The author built a DIY GPU-like parallel computing cluster using 65536 low-cost RISC-V microcontrollers (CH570), achieving QVGA resolution rendering, and solved engineering challenges such as power supply, heat dissipation, and programming automation.