agent-looping

Tag

Cards List
#agent-looping

Qwen3.8 27b loop testing int4 awq vs int8

Reddit r/LocalLLaMA ↗ · yesterday

A practitioner compares Qwen3 27B running INT8 vs INT4 AWQ over two weeks of heavy agent logs, finding INT4 dramatically increases reasoning-loop rates (1.9 vs 4.7 loops/1k calls), cuts task success from 92% to 78%, and the gap widens at long context above 100k tokens. INT8 and even BF16 also loop, so quantization amplifies rather than causes the issue.

0 favorites 0 likes
← Back to home

Submit Feedback