avx2

Tag

Cards List
#avx2

[Draft - Open PR] AVX2: Speed up large batch size prompt processing of IQ models by bartowski1182 · Pull Request #27402 · ggml-org/llama.cpp

Reddit r/LocalLLaMA · 2026-08-20 Cached

This draft pull request introduces AVX2 optimizations to speed up large batch size prompt processing for IQ models in llama.cpp, an open-source tool for efficient LLM inference.

0 favorites 0 likes
#avx2

85.3 GFlops: Optimizing FP32 Matrix Multiplication on a Single AMD Zen 3 Core

Hacker News Top · 2026-07-17 Cached

A systematic exploration of FP32 matrix multiplication optimization on AMD Zen 3, achieving 85.30 GFLOPS (63.5% of theoretical peak) using AVX2/FMA intrinsics, surpassing naive implementation by 56.5x and matching optimized libraries.

0 favorites 0 likes
#avx2

What it takes to transpose a matrix

Hacker News Top · 2026-05-24 Cached

An in-depth technical blog post explaining how to efficiently transpose matrices using SIMD instructions on modern x86_64 CPUs, focusing on AVX2 intrinsics like _mm256_shuffle_epi8.

0 favorites 0 likes
← Back to home

Submit Feedback