YSK: Strata and polystrata have this functionality called answer_room

Reddit r/LocalLLaMA Tools

Summary

YSK post revealing that Strata/PolyStrata silently caps model thinking at 75% of max_tokens via an 'answer_room' feature and injects a wrap-up nudge in the model's own voice, with no error, flag, or finish reason surfaced to the client.

With default settings and thinking on and max_tokens ≥ 1024, and no explicit reasoning_budget_tokens, Strata / PolyStrata has a behavior called answer_room which will silently cap thinking at 0.75. * max_tokens and inject a "wrap-up" line in the model's head in its own voice, saying I have thought about this long enough; time to give my answer. + </think> It then continues the same reply from there. The client (harness, you or I) gets no error, flag or finish reason for this, and often no log. This matters when you compare between strata and other engines : models served by strata had "nudges" in the form of its inner voice, and such extra text in the transcript. In some cases the nudge line is injected mid thinking, quite abruptly and it is hard to tell whether it helps or harms. Strata main @ c62d5e3 Wrap-up message: https://github.com/Niko1221/Strata/blob/c62d5e3a15b40ea51c96aae9e8d36928965f53ab/serve/server.py#L225 Trigger (the 3/4 budget): https://github.com/Niko1221/Strata/blob/c62d5e3a15b40ea51c96aae9e8d36928965f53ab/serve/server.py#L5491 Injection point: https://github.com/Niko1221/Strata/blob/c62d5e3a15b40ea51c96aae9e8d36928965f53ab/serve/server.py#L5848 Default on (answer_room = True): https://github.com/Niko1221/Strata/blob/c62d5e3a15b40ea51c96aae9e8d36928965f53ab/serve/server.py#L4181 I noticed this when a model that tends to have long front-loaded thinking on dgx spark gave slightly but uniformly shorter answers (and task performance worsened in my hard problems), when served on polystrata.
Original Article

Similar Articles

Real downsides of Strata?

Reddit r/LocalLLaMA

A community discussion about the real-world downsides of the Strata model, comparing its performance in agentic workloads against Qwen 27B and other quantized models on llama.cpp, with mixed reports on quality loss versus speed gains.

@neural_avb: https://x.com/neural_avb/status/2063907440509571354

X AI KOLs Timeline

Explores a common failure mode in recursive language models (RLMs) where free-text subagent responses cause issues, and presents a solution using structured outputs to improve reliability, illustrated with a long-context question-answering example from NarrativeQA.