Tag
llama.cpp 的 PR #26610 由 am17an 提交，为 RPC 后端新增 `-sm tensor`（tensor split）选项，使张量可在多设备 RPC 服务器间分配。
A user configured a mismatched pair of Tesla V100 GPUs (16GB and 32GB) into a capable local LLM lab using llama.cpp with tensor split and other optimizations, achieving high prompt and decode speeds with the Qwen3.8 27B model.
A user shares optimized settings for running Qwen3.6 27B (Q8_0) on a dual GPU setup (RTX 4090 + RTX 3090) with llama.cpp, achieving 75-100 t/s and 1500 pp with 250k context.