thinking-budget

Tag

Cards List
#thinking-budget

YSK: Strata and polystrata have this functionality called answer_room

Reddit r/LocalLLaMA ↗ · 2026-11-02

YSK post revealing that Strata/PolyStrata silently caps model thinking at 75% of max_tokens via an 'answer_room' feature and injects a wrap-up nudge in the model's own voice, with no error, flag, or finish reason surfaced to the client.

0 favorites 0 likes
#thinking-budget

Qwen3.6 35B MoE on 8GB VRAM — working llama-server config + a max_tokens / thinking trap I ran into

Reddit r/LocalLLaMA ↗ · 2026-04-21

Author shares a working llama-server config to run the 35B-MoE Qwen3.6 model on an 8GB RTX 4060, highlighting a max_tokens trap caused by unconstrained internal reasoning and the fix using per-request thinking_budget_tokens.

0 favorites 0 likes
← Back to home

Submit Feedback