Tag
一篇技术博客，介绍如何利用浮点数指数相当于对数这一特性，用 AVX2 浮点指令实现可向量化的 clz（前导零计数）和 ctz（尾随零计数）多播（polyfill），并在 Haswell/Alder Lake 上给出优于标量版本的性能数据。
A personal project presents PULSAR-ASM, a minimal LLM inference engine written entirely in flat x86-64 assembly (FASM) that runs Gemma-2B in FP16 with a 5.2 KB binary footprint, zero C/C++ runtime dependencies, and ~4.5-4.7 tokens/s on an older quad-core CPU — framed as a first-principles exploration for bare-metal and microcontroller LLM inference.
This draft pull request introduces AVX2 optimizations to speed up large batch size prompt processing for IQ models in llama.cpp, an open-source tool for efficient LLM inference.
A systematic exploration of FP32 matrix multiplication optimization on AMD Zen 3, achieving 85.30 GFLOPS (63.5% of theoretical peak) using AVX2/FMA intrinsics, surpassing naive implementation by 56.5x and matching optimized libraries.
An in-depth technical blog post explaining how to efficiently transpose matrices using SIMD instructions on modern x86_64 CPUs, focusing on AVX2 intrinsics like _mm256_shuffle_epi8.