Tag
Auto-GPU-Kernel version 1.0 is released, an autonomous GPU kernel generation and optimization tool that ranked first in the MLSys 2026 FlashInfer AI Kernel Generation Contest with a 34.93x average speedup.
Windowed A-K-MDP algorithm improves MDP state abstraction for conservation by generating feasible partitions within a window, reducing decision loss in 25 out of 33 test cases compared to binary search methods.
This paper proposes a method to dynamically set inference depth in AI models based on the actual questions encountered during deployment to enhance computational efficiency.
The article presents a custom fork of llama.cpp optimized for NVIDIA Ampere architecture GPUs like the 3090, achieving over 90 tokens per second for 27B parameter models with large context windows, making local inference faster than API speeds.
A tweet explains the optimization principle behind Flash attention, focusing on minimizing data movement and maximizing on-chip memory reuse, in the context of a language modeling course lecture.
PostgreSQL takes locks on all indexes during query planning, which can cause CPU contention with many indexes, and prepared statements can mitigate this issue.
UkisAI has post-trained the Qwen 3.8 27B model to reduce unnecessary thinking tokens by 58% and achieve 1.95x speed up with less than 1% accuracy loss, open-sourcing the model and offering a free research API.
The paper proves almost sure convergence of stochastic gradient descent with clipping and additive noise, including momentum variants, under smoothness and bounded gradient noise assumptions, providing theoretical foundations for stable training in convex and nonconvex settings.
shi3z shares optimization experience for running DeepSeek v4.1 Flash on an A100 GPU without FP4 support, boosting inference speed from 33 tok/s to 673 tok/s, surpassing the official API speed.
The article expresses hope for future AI models with optimizations like KVCache and Engram to reduce memory usage, enabling larger models to run on consumer GPUs with limited VRAM.
The article presents COBRA-Skills, a method using contextual bandits to efficiently optimize agent skills, reducing costs by avoiding repeated LLM-based trajectory analysis and skill rewriting.
This article explains lazy initialization in C++ to optimize performance by deferring computations until necessary, using a helper struct to exploit conversion operators in std::optional.
The article reflects on how hardware shortages in the local LLM community are driving hands-on optimization and learning, evoking the early internet era, in contrast to today's easily distracted mainstream culture.
The article explains how the `clippy::nonstandard_macro_braces` lint in Rust was optimized by 3133X, focusing on improving performance by addressing inefficiencies in handling macro expansions during compilation.
The article discusses a method for compressing a boolean flag into 11 bits, focusing on efficient data encoding techniques.
NVIDIA uses Palantir Foundry and cuOpt to automate supply chain allocation decisions, training Nemotron 3.5 Lightning on unstructured operational data to improve decision accuracy.
OpenAI's official team has released a major update for GPT-6 Astra, providing best practices for settings like AGENTS.md to optimize token usage and efficiency.
The paper proposes belief-shift branching for tree-structured reinforcement learning to enhance step-level credit assignment, demonstrating improved performance in mathematical and coding benchmarks.
A multi-agent framework automates the generation of QUBO formulations from natural language descriptions, achieving 68% accuracy on the introduced QUBOBench benchmark.
uv's ZIP extraction has been optimized by moving it to a single blocking task with synchronous filesystem operations, inspired by code from Bun, leading to faster installation of packages like Jupyter from PyPI.