Tag
Follow-up benchmark post showing GCMP, a LoRA replacement, matches LoRA r=32 accuracy on Qwen3.8-27B with 55× fewer adapter parameters (2.9M/11MB vs 159M/320MB), with details on serving memory, training speed trade-offs, and 4-bit base comparisons.
The author benchmarks serving 1,000 LoRA adapters on one GPU using vLLM, finding that active adapter count and traffic shape are the real bottlenecks, and provides recommendations for tuning max_loras.