mirror of
https://github.com/MBombeck/HealthLog.git
synced 2026-11-12 14:16:12 +00:00
Marc-André Bombeck
b90980f2a2
A reply that ran into the token ceiling with unlabelled text was read as reasoning the server did not separate whenever the ceiling held room for reasoning, which is every call that carries a level, Off included. A model that does not reason at all (llama3.1) lost its own truncated answer: the call failed as reasoning_only, the briefing never reached its JSON-shape retry, the Coach named the wrong error, the failure counted toward the bench, and the client learned to ask with "none" for an hour. Such text is now reasoning only once the endpoint and model have shown that they reason: a reasoning field or a think tag in an earlier reply, or a lesson that says so (knownReasoner). A sighting on a request that asked to reason speaks only for requests that ask too. Otherwise the text is the answer, cut off, with finishReason "length". A lone closing </think> now splits a reply only where the chat templates put it, at the start of a line, or anywhere once the model is known to reason. An ordinary answer that mentions the tag in a sentence stays whole. Two expectations encoded the old rule and move: the Coach loop case whose first reply is unlabelled template-opened text from a model never seen reasoning, and the Local case that read a never-seen model's cut text as a thought. The streamed think-block splitting moved into local-reasoning.ts. Refs #1276