book-translation

#book-translation

Running a 2-model literary book-translation pipeline on 2x Tesla P40: gemma-4-26B-A4B at ~40 tok/s + Qwen3.6-35B-A3B at 50-70 tok/s with MTP spec decode — full llama-server flags inside

Reddit r/LocalLLaMA ↗ · 2d ago

The article details an open-source tool 'Sunny Narrator' for translating fiction books using a two-model AI pipeline on Tesla P40 GPUs, with optimized llama-server configurations achieving 40-70 tokens per second via MTP speculative decoding.

0 favorites 0 likes

book-translation

Running a 2-model literary book-translation pipeline on 2x Tesla P40: gemma-4-26B-A4B at ~40 tok/s + Qwen3.6-35B-A3B at 50-70 tok/s with MTP spec decode — full llama-server flags inside

Submit Feedback