float8

Tag

Cards List
#float8

Extened garlic to run Qwen3.5 35B A3B float8 at 55 tok/s on RTX 5060 Ti

Reddit r/LocalLLaMA ↗ · 2026-07-24

A technique called 'Extened Garlic' enables running Qwen3.5 35B A3B model at 55 tok/s using float8 precision on an RTX 5060 Ti.

0 favorites 0 likes
← Back to home

Submit Feedback