YSK: Strata and polystrata have this functionality called answer_room
Reported by r/LocalLLaMA1 source ↓
A r/LocalLLaMA post says Strata and PolyStrata can end model thinking at 75% of the token budget and insert a wrap-up prompt, without notifying the client. The behavior is on by default under specified settings, according to the post.
Key points
- The post says answer_room caps thinking at 75% of max_tokens and adds a wrap-up line
- It is triggered with thinking on, max_tokens of at least 1,024, and no explicit reasoning_budget_tokens
- The post says clients receive no error, flag, or finish reason when it happens
- The poster reports shorter answers and worse performance on hard problems in one comparison
Details
The r/LocalLLaMA post describes a Strata behavior called answer_room, which it says is enabled by default. With thinking enabled, max_tokens set to at least 1,024, and no explicit reasoning_budget_tokens, the server caps thinking at three-quarters of max_tokens and inserts a wrap-up line in the model’s voice before continuing the reply.
According to the post, clients are not given an error, flag, or finish reason, and the behavior may not appear in logs. The poster says the inserted line can interrupt thinking abruptly and may affect comparisons with other engines. They report observing shorter answers and worse performance on hard problems when serving a model through PolyStrata; the post does not provide benchmark results.
Written from coverage as of