matrix-multiplication

Tag

Cards List
#matrix-multiplication

AI cracks a 27-year-old pillar of computer science, OpenAI and Anthropic claim

Reddit r/artificial ↗ · 2026-10-30

OpenAI and Anthropic claim their AI systems have cracked a 27-year-old open problem in computer science, marking a major milestone for AI-driven mathematical discovery.

0 favorites 0 likes
#matrix-multiplication

@ickma2311: ∇ Stanford CS336 (Spring 2026) — Lecture 6: Kernels and Triton A shorter tensor expression does not necessarily mean fe…

X AI KOLs Following ↗ · 2026-10-18 Cached

斯坦福 CS336(2026 春)第 6 讲的笔记,讲解如何通过减少 GPU 内存往返来优化内核:对比 softmax 多次遍历与融合行内核的内存流量,介绍 Triton 的块级编程模型,并强调先用 CUDA event 测量基线、再做内核融合与分块优化。

0 favorites 0 likes
#matrix-multiplication

Algebraic Integer Quantization for Machine Learning Applications

arXiv cs.LG ↗ · 2026-10-12 Cached

本文提出代数整数量化(AIQ)作为大语言模型推理的有损压缩格式,利用代数整数可实现无误差乘加运算的特性构建矩阵乘法引擎,在等比特预算下达到与业界标准 MX 格式竞争的精度。

0 favorites 0 likes
#matrix-multiplication

Internal Anthropic model refuted the 3SUM and APSP hypotheses: first truly subquadratic 3SUM and truly subcubic APSP (Alman & Vassilevska Williams)

Reddit r/singularity ↗ · 2026-10-06 Cached

An internal Anthropic Claude model discovered the first truly subquadratic 3SUM algorithm (O(n^1.9992)) and truly subcubic APSP algorithm (O(n^2.9995)), refuting the long-standing 3SUM and APSP hypotheses in fine-grained complexity theory. The result, formalized in a paper by Josh Alman and Virginia Vassilevska Williams, stems from a new thin matrix multiplication algorithm and was verified using Lean 4.

0 favorites 0 likes
#matrix-multiplication

Change the Product, Keep the Parameters: Associative Algebra Layers for Transformers

Hugging Face Daily Papers ↗ · 2026-09-26 Cached

The paper investigates replacing matrix multiplication in Transformer layers with an associative algebra product to reduce arithmetic cost while retaining parameters, demonstrating feasibility with improved throughput but some performance trade-offs.

0 favorites 0 likes
#matrix-multiplication

vulkan: int8 coopmat1 matmul implementation for AMD RDNA3 and RDNA4 (… · ggml-org/llama.cpp@70c4e15

Reddit r/LocalLLaMA ↗ · 2026-09-24 Cached

This update to llama.cpp introduces a Vulkan-based implementation of int8 cooperative matrix multiplication for AMD RDNA3 and RDNA4 GPUs, enhancing inference performance on these hardware platforms.

0 favorites 0 likes
#matrix-multiplication

@jessiedong_: split-K matrix multiplications are known for giving different answers even when the code and inputs are the same. but h…

X AI KOLs Timeline ↗ · 2026-09-02 Cached

The article describes experiments on split-K matrix multiplications, revealing that answer variability depends on block layouts and split counts, with tests on a B200 GPU showing output changes under different conditions.

0 favorites 0 likes
#matrix-multiplication

Improving the matrix multiplication exponent with modern optimization and AlphaEvolve

Hugging Face Daily Papers ↗ · 2026-08-17 Cached

The paper proposes improvements to the optimization problem in combination loss analysis using modern techniques and AlphaEvolve, yielding an improved upper bound on the matrix multiplication exponent.

0 favorites 0 likes
#matrix-multiplication

Discrete Fourier Transform by Hand

Hacker News Top ↗ · 2026-08-14 Cached

This article provides a step-by-step guide to calculating the Discrete Fourier Transform (DFT) by hand, demonstrating that it involves matrix multiplications similar to those in deep neural networks.

0 favorites 0 likes
#matrix-multiplication

@ProfTomYeh: Backpropagation by hand ~ 11 steps walkthrough below Backpropagation is the algorithm that actually trains a neural net…

X AI KOLs Timeline ↗ · 2026-07-20 Cached

A walkthrough of backpropagation by hand through a 3-layer network using matrix multiplication, showing all 11 steps from gradients to weight updates.

0 favorites 0 likes
#matrix-multiplication

85.3 GFlops: Optimizing FP32 Matrix Multiplication on a Single AMD Zen 3 Core

Hacker News Top ↗ · 2026-07-17 Cached

A systematic exploration of FP32 matrix multiplication optimization on AMD Zen 3, achieving 85.30 GFLOPS (63.5% of theoretical peak) using AVX2/FMA intrinsics, surpassing naive implementation by 56.5x and matching optimized libraries.

0 favorites 0 likes
#matrix-multiplication

The Powerhouse of the AI Chip (6 minute read)

TLDR AI ↗ · 2026-07-16 Cached

This article explains how systolic arrays handle over 95% of AI chip compute, detailing their design, modes of operation, and why they are efficient for matrix multiplication.

0 favorites 0 likes
#matrix-multiplication

Is x86 ready to ACE it?

Hacker News Top ↗ · 2026-07-14 Cached

The article analyzes the new ACE specification from the x86 Ecosystem Advisory Group, which extends Intel's AMX for AI matrix multiplication with fixed tile sizes and outer product instructions, comparing it to Arm's SME.

0 favorites 0 likes
#matrix-multiplication

@mkvenkit: Google’s Tensor Processing Unit (TPU) uses the systolic array architecture - an idea from 1978 - to accelerate matrix m…

X AI KOLs Timeline ↗ · 2026-06-27 Cached

Google's TPU uses the systolic array architecture from 1978 to accelerate matrix multiplication with less memory movement. The post shares links to the original paper and TPU design, and suggests building a small-scale version on an FPGA.

0 favorites 0 likes
#matrix-multiplication

[x86] AI Compute Extensions (ACE) Specification

Hacker News Top ↗ · 2026-06-18 Cached

The x86 Ecosystem Advisory Group has published the AI Compute Extensions (ACE) specification, defining new x86 instructions and register state for accelerating matrix multiplication and reduced precision data formats in machine learning workloads.

0 favorites 0 likes
#matrix-multiplication

Training an LLM in Swift, Part 1: Taking matrix mult from Gflop/s to Tflop/s

Hacker News Top ↗ · 2026-05-10 Cached

The author details the process of optimizing custom matrix multiplication kernels in Swift to train a Large Language Model on Apple Silicon, aiming to outperform C implementations by leveraging CPU, SIMD, AMX, and GPU capabilities.

0 favorites 0 likes
#matrix-multiplication

Getting peak TOPS on a Ryzen AI 7 350 NPU

Lobsters Hottest ↗ · 2026-05-08 Cached

A technical deep-dive into achieving peak TOPS performance on the AMD Ryzen AI 7 350 NPU, comparing it to Xilinx AIE-ML v2 AI engines and explaining the hardware architecture for matrix multiplication workloads.

0 favorites 0 likes
← Back to home

Submit Feedback