cuda-optimization

Tag

Cards List
#cuda-optimization

@elliotarledge: claude opus 5.5 just one-shot a music video on how to optimize CUDA kernels

X AI KOLs Following ↗ · 2026-09-27 Cached

The tweet highlights Claude Opus 5.5's ability to generate a music video about optimizing CUDA kernels in a single attempt.

0 favorites 0 likes
#cuda-optimization

@Anbeeld: BeeLlama v0.4.7 is out! You can now save gigabytes of VRAM when using MTP and DFlash! In the example shown in the image…

X AI KOLs Timeline ↗ · 2026-09-25

BeeLlama v0.4.7 is released, offering gigabytes of VRAM savings through independent drafter ubatch sizing for MTP and DFlash, along with major ROCm and CUDA performance enhancements for AI inference.

0 favorites 0 likes
#cuda-optimization

Qwen3.8-27B at 256K on a 24GB RTX PRO 4000 SFF (432 GB/s): 50 tok/s with MTP

Hacker News Top ↗ · 2026-08-17 Cached

The article details an experiment achieving 50 tokens per second inference with Qwen3.8-27B at 256K context on a 24GB GPU using Multi-Token Prediction and custom optimizations.

0 favorites 0 likes
#cuda-optimization

NInfer day0 support for Qwen3.8 27b: ~200 tok/s generation, with tons of engine improvments

Reddit r/LocalLLaMA ↗ · 2026-08-14

NInfer adds day-0 support for the Qwen3.8-27B model, achieving around 200 tokens per second on a single RTX 5090 with speculative decoding, and includes engine improvements like concurrent requests and kernel optimizations.

0 favorites 0 likes
#cuda-optimization

@dair_ai: Outstanding paper on long-horizon agents. (bookmark it) Similar to humans, how do you make agents persist on a difficul…

X AI KOLs Following ↗ · 2026-06-04 Cached

AutoLab is a new benchmark evaluating 17 frontier models on 36 expert-curated long-horizon tasks (system optimization, model development, CUDA kernels, puzzles), finding that persistence—not initial attempt quality—is the dominant predictor of success. Claude-opus-4.6 led all categories, while most other models terminated prematurely or exhausted budgets with minimal progress.

0 favorites 0 likes
#cuda-optimization

@modal: New replicas of @vllm_project and @sgl_project servers start up 3-10x faster on Modal. Read the article to learn how --…

X AI KOLs Following ↗ · 2026-05-12 Cached

Modal has announced that replicas of vLLM and SGLang servers now start up 3-10x faster, leveraging improvements in GPU health management and CUDA context checkpointing.

0 favorites 0 likes
#cuda-optimization

A hackable compiler to generate efficient fused GPU kernels for AI models [P]

Reddit r/MachineLearning ↗ · 2026-05-11

The author presents a custom, hackable ML compiler written in Python that lowers LLMs to optimized CUDA kernels through a multi-stage IR pipeline, achieving performance competitive with or superior to PyTorch on specific operations. The article details the compiler's optimization passes, lowering rules, and CLI usage for generating efficient fused GPU kernels.

0 favorites 0 likes
#cuda-optimization

RTX Pro 4500 Blackwell - Qwen 3.6 27B?

Reddit r/LocalLLaMA ↗ · 2026-05-09

A developer shares local inference benchmarks and systemd configurations for running the Qwen3.6-27B model on an NVIDIA RTX Pro 4500 Blackwell GPU using llama.cpp. The post requests optimization tips for throughput and explores potential use cases for larger models.

0 favorites 0 likes
← Back to home

Submit Feedback