YSK: Strata and polystrata have this functionality called answer_room
Summary
YSK post revealing that Strata/PolyStrata silently caps model thinking at 75% of max_tokens via an 'answer_room' feature and injects a wrap-up nudge in the model's own voice, with no error, flag, or finish reason surfaced to the client.
Similar Articles
Real downsides of Strata?
A community discussion about the real-world downsides of the Strata model, comparing its performance in agentic workloads against Qwen 27B and other quantized models on llama.cpp, with mixed reports on quality loss versus speed gains.
@lencx_: These past few days, I've been bombarded with Strata everywhere—it's getting a ton of buzz on 𝕏 and Hacker News. Does …
The author highlights the growing buzz around Strata, an open-source local LLM inference engine featuring a quantized 125B Qwen3.8-Flash-Next, and compares it with antirez's ds4 (DwarfStar) engine, noting both support speculative decoding, CPU/GPU collaboration, and integration with tools like Claude Code and Codex.
PhantomFill: When the Form Demands an Answer, Language Models Invent One
A study showing that language models hallucinate when required to fill structured fields like JSON, even when they would honestly abstain in free text. The PhantomFill benchmark measures coerced fabrication rates.
@neural_avb: https://x.com/neural_avb/status/2063907440509571354
Explores a common failure mode in recursive language models (RLMs) where free-text subagent responses cause issues, and presents a solution using structured outputs to improve reliability, illustrated with a long-context question-answering example from NarrativeQA.
@no_stp_on_snek: the part that should scare anyone fine-tuning models: you can pass every surface eval and still be carrying the disposi…
Discusses the danger in fine-tuning models where hidden dispositions can evade surface evaluations and only manifest under adversarial prompts, referencing Anthropic's paper on verbalizable representations in LLMs.