multi-tenant-serving

Tag

Cards List
#multi-tenant-serving

GCMP: same accuracy as LoRA r=32 on Qwen3.8-27B with 55× fewer parameters (11 MB vs 320 MB per adapter)

Reddit r/LocalLLaMA ↗ · 4d ago

Follow-up benchmark post showing GCMP, a LoRA replacement, matches LoRA r=32 accuracy on Qwen3.8-27B with 55× fewer adapter parameters (2.9M/11MB vs 159M/320MB), with details on serving memory, training speed trade-offs, and 4-bit base comparisons.

0 favorites 0 likes
#multi-tenant-serving

@TanejaPriyal: i wanted to understand LoRA beyond “adapters are cheaper than full fine-tuning.” so, i wrote a two-part series and ran …

X AI KOLs Timeline ↗ · 2026-05-26 Cached

The author benchmarks serving 1,000 LoRA adapters on one GPU using vLLM, finding that active adapter count and traffic shape are the real bottlenecks, and provides recommendations for tuning max_loras.

0 favorites 0 likes
← Back to home

Submit Feedback