c++

Sharp v22.1 template reduces Qwen model output tokens by 42% without speed loss, integrated into an NInfer fork for 5090 via C++ modifications.

The article explains how to reduce C++ template bloat by factoring out type-dependent portions of functions, using a practical example with Windows DispatcherQueueHandler to de-templatize code.

This article explains techniques to reduce C++ template bloat by factoring out type-dependent code into helper objects or using span-based approaches, enhancing code efficiency and maintainability.

The article explains that wrapping a callable in a lambda is unnecessary when the inner lambda can be used directly, highlighting that C++ lambdas are syntactic sugar for classes with function call operators.

The article discusses the internal conflicts within the C++ community regarding ABI breaks and memory safety, alongside government warnings and big tech companies shifting towards Rust.

This article explains C++20's std::counting_semaphore and std::binary_semaphore, covering their API, usage for limiting concurrency and signaling between threads, and important details.

A deep dive into optimizing UTF-8 decoding in the utfcpp library, revealing that Clang and GCC generate different assembly for ASCII fast paths, leading to significant performance differences.

Raymond Chen continues his series on building an agile Windows Runtime delegate in C++/WinRT, comparing how C++/WinRT, C++/CX, and WRL handle non-marshalable delegates and agile reference creation.

A blog post highlights that C++ float-to-int conversion is undefined behavior when the value doesn't fit, and points out that Microsoft's GSL library's safe narrowing function 'gsl::narrow' also suffers from this UB, contrary to its documentation.

Kimi K3 text-only model is now supported in llama.cpp, enabling local inference of this open-source LLM using the C++ inference engine.

The article critiques memory safety absolutism in programming language debates, arguing that new approaches like Fil-C have trade-offs and that dismissing Rust as unsafe ignores practical benefits.

Fil-C is a fully memory-safe implementation of C/C++. It bundles pointer values with boundary information using invisicaps at the LLVM IR stage, achieving high compatibility with a performance penalty of about 4x.

A guide to implementing a fast lock-free queue in modern C++, covering techniques for concurrent data structures without locks.

This paper presents a systems study comparing C++ and PyTorch inference runtimes for reward model scoring in RLHF pipelines, finding that ONNXRuntime provides speedups on CPU while torch.compile leads on GPU, with batching strategy mattering more than language or runtime.

Gecode 6.3.0 and 6.4.0 are released after a long pause, bringing a modernized build system (CMake) and updated MiniZinc integration.

C++20 introduces a new syntax for range-based for loops that allows declaring an initializer in the loop scope, matching the convenience of languages like Python and Lua.

A pull request adds an initial ET backend to llama.cpp, expanding hardware support for LLM inference.

A detailed overview of all C++20 core language features with examples, serving as a cheat sheet.

Article comparing old C++ performance tricks with modern compiler capabilities, showing that compilers can now optimize naive code better than hand-tuned hacks. Includes benchmarks on AMD Zen 5 with Clang 21.

BUSY is a lean, statically typed, cross-platform build system for GCC, Clang, and MSVC toolchains, designed for easy bootstrapping and minimal dependencies.