The LLVM Compiler Infrastructure
Summary
LLVM is a collection of modular and reusable compiler and toolchain technologies used for developing compiler front ends and back ends.
Similar Articles
llvm/llvm-project
This repository hosts the LLVM compiler infrastructure, a modular toolkit for building highly optimized compilers, optimizers, and runtimes, alongside related components including the Clang frontend, libc++ standard library, and LLD linker.
A tour of MLIR: The Dialect Stack Everyone Depends On
This post explains MLIR as a compiler infrastructure framework that provides a flexible dialect stack, describing how it is used across modern ML compilers like XLA, Triton, and Mojo to progressively lower tensor operations to machine code.
Why we write our own C and C++ inference engines
LocalAI explains why it writes its own C/C++ inference backends, showing that its vllm.cpp port achieves comparable or better throughput and far smaller footprint than vLLM, with benchmarks across multiple models and hardware.
Fighting Hyrum's Law in LLVM
This article surveys mechanisms within the LLVM compiler infrastructure designed to prevent dependencies on unspecified behavior, known as Hyrum's Law, to ensure build reproducibility.
@0xSero: Here's everything you need to know about inference and hosting LLMs. Have you ever seen: - vllm - sglang - llama.cpp - …
An overview of popular open-source inference engines including vLLM, SGLang, llama.cpp, and ExLlamaV3 for hosting and running large language models.