Tag
This pull request adds a fast Walsh-Hadamard transform implementation for CUDA in llama.cpp, a popular open-source LLM inference engine. The optimization enhances performance for certain computational operations on NVIDIA GPUs.
A pull request for llama.cpp fixes the constant prompt processing issue that occurs when using OpenCode or Pi with the library.
This pull request optimizes llama.cpp by avoiding unnecessary copying of logits during prompt decode in multi-token prediction, improving inference performance.
The pull request adding MTP (Multi-Token Prediction) support to llama.cpp has been merged into the master branch.
A pull request for MTP (likely a model training pipeline or similar) related to LLaMA models has been merged, marking a milestone.
Pull request adding Multi-Token Prediction (MTP) support to llama.cpp, enabling speculative decoding for faster inference.
An AI agent built with LangChain continuously monitors its own codebase, flags missing monitors, and automatically opens PRs to fix bugs it finds, as described by Alex Shevchenko from Ramp.