pull-request

This pull request makes tensor parallelism (TP) viable in llama.cpp when using the Vulkan backend, enabling distributed inference across multiple GPUs.

Bun has an open pull request that adds support for shared-memory threads to JavaScriptCore, the JavaScript engine underlying WebKit. This enhancement could improve performance for multi-threaded JavaScript workloads in Bun.

Today Devin receives a huge security upgrade, allowing it to review every pull request with the depth of a security engineer.

A developer from Apple submitted a pull request to Godot with an AI use disclosure, which the tweeter liked and suggests adopting for open source contributions.

Pull request #24080 for llama.cpp adds UI/svg block rendering, enhancing the project's interface capabilities.

A pull request to vLLM adds support for tensor parallelism degree 3 for MiniMax M3 with its NVFP4 quantization, enabling the model to run on 3x DGX Sparks with 87GB memory each.

This tweet promotes Devin, an AI coding tool that works autonomously in the cloud and can produce pull requests without user supervision, linking to a tutorial video.

Pull request to add architecture support for the cohere2-MoE model to llama.cpp, enabling inference of this Mixture of Experts model.

A pull request for llama.cpp that removes padding and multiple device-to-device copies for Multi-Token Prediction (MTP), improving performance on GPU.

This pull request adds video input support to llama.cpp, enabling multimodal models to process video data via the new mtmd component.

This pull request by ggerganov optimizes kv-cache in llama.cpp to avoid unnecessary copies of kv cells, improving inference performance. It is a contribution to the open-source LLM inference library llama.cpp.

A pull request for llama.cpp ports multi-column MMVQ from CUDA to SYCL, achieving approximately 45% speculative decoding speedup on Intel Arc GPUs.

This pull request adds support for the Granite4 Vision model to llama.cpp, an open-source LLM inference engine.

Adds support for rendering Mermaid diagrams in chat and an interactive preview within the llama.cpp web UI.

Pull request adding support for StepFun 3.5 MTP model in llama.cpp.

llama.cpp is an open-source LLM inference engine in C/C++ with minimal dependencies and support for various hardware and quantization methods. This pull request limits the maximum outputs of llama_context.

Peter Steinberger used Codex to build a fully automated QA bot that automatically generates tests, runs tests after each code commit, and can automatically fix bugs and submit PRs, greatly improving development efficiency.

This pull request for the llama.cpp inference engine implements using f16 mask for Flash Attention to reduce VRAM usage.

This pull request adds tokenizer support for MiniCPM5 to llama.cpp, extending the tool's compatibility with the MiniCPM family of models.

A rejected PR for llama.cpp provides up to 30% faster prompt processing for MOE models on AMD Strix Halo hardware, with gains diminishing at higher context lengths.