compilation

This article compiles and shares various human interface guidelines from platforms like Apple, Amiga, and others, serving as a valuable resource for UI designers and developers.

A project compiles Doom's rendering algorithm into a 21B-parameter transformer without any training, using a custom compiler. The resulting model can generate rendered frames of Doom, albeit slowly at 35 frames per day on a B200 GPU.

This paper presents an MLIR-based compilation method for large language models, using two custom dialects (TopOp and TpuOp) to lower models from framework-agnostic semantics to hardware-specific instructions. It also introduces a three-stage static compilation for autoregressive inference stages: prefill, prefill_kv, and decode.

The article benchmarks the WebAssembly-to-C approach using wasm2c with wide arithmetic support, demonstrating that it remains competitive with dedicated WebAssembly runtimes like Wasmer and Wasmtime in both speed and memory usage.

Amber is a modern, type-safe programming language that compiles to Bash, Ksh, or Zsh, enabling safer and more robust shell scripting.

A detailed technical walkthrough of the process from compiling a CUDA kernel to its execution on an RTX 4090, covering the NVCC compilation pipeline, PTX, SASS, and the underlying system calls.

Skill-DisCo is a framework that distills reusable procedural skills from successful agent traces and compiles them into callable, executable programs. Experiments on ALFWorld and WebArena show improved success rates and reduced agent turns.

AutoMegaKernel is an open-source agent harness that compiles any HuggingFace model into a single persistent megakernel, fusing the entire forward pass into one GPU launch to reduce overhead. It achieves up to 1.33x speedup over CUDA-graphed cuBLAS on inference-class GPUs like L4 and L40S, while proving schedules deadlock- and race-free.

The author discovered that compiling llama.cpp with both CUDA and Vulkan backends simultaneously is possible, yielding a ~10% improvement in tokens/sec for decoding. They plan to run further benchmarks to assess the benefits.

The Zig build system has been reworked to separate the configurer and maker processes, enabling caching, release-mode compilation, and up to 90% faster 'zig build' commands. This change improves performance and allows the build system to grow features without slowing down.

PyTorch 2.12 release includes major updates to compilation, export, distributed training, and accelerator support, with up to 100x faster batched linalg.eigh on CUDA and new APIs like torch.accelerator.Graph.

This technical guide provides a step-by-step process for compiling Emacs from source on various Linux distributions to optimize performance through CPU-specific instruction sets and modern display protocols like Wayland. It also covers configuring dependencies and fine-tuning the native Lisp compiler for faster execution.

ReaComp compiles LLM reasoning traces into reusable symbolic program synthesizers that achieve strong accuracy on program synthesis benchmarks while eliminating LLM calls at test time, significantly reducing computational cost.

A detailed guide on recreating the process of compiling Quake's win32 binaries using vintage tools like Windows NT 4 and Visual C++ 6, as done in 1997.