marlin

Tag

Cards List
#marlin

For V100 Users: SGLang running Qwen+Dflash and Laguna

Reddit r/LocalLLaMA ↗ · 2026-07-27

Modified SGLang to support Qwen and Laguna models on V100 GPUs using custom FlashAttention and Marlin kernels, achieving decent throughput on 4xV100 hardware.

0 favorites 0 likes
← Back to home

Submit Feedback