tok-per-second

Tag

Cards List
#tok-per-second

Proposal: A community revolution for private quality benchmarks (and why endless chasing tok/s is rotting our brains

Reddit r/LocalLLaMA ↗ · 6d ago

A community proposal in r/LocalLLaMA urging members to stop fixating on tok/s speed metrics and instead create private quality benchmarks, especially to evaluate model quality across quantisation levels, and to share results with each other.

0 favorites 0 likes
← Back to home

Submit Feedback