diff --git a/docs/modules/harness/model-behaviour.md b/docs/modules/harness/model-behaviour.md index cedfb5387..343adedaa 100644 --- a/docs/modules/harness/model-behaviour.md +++ b/docs/modules/harness/model-behaviour.md @@ -59,8 +59,11 @@ http }` lets a host hook the OpenAI and Anthropic adapters' Chat Completions/Messages transport without the harness knowing about the hook: `on_payload: Option>` mutates the wire body immediately before it is sent, `on_response: Option>` observes the raw response JSON after a successful call, and -`http: Option` overrides the adapter's own client. Set it at +Send + Sync>>` observes the raw response JSON after a successful call (an +OpenAI `invoke` fulfilled by streaming, as `local-openai` models do, passes a +Chat Completions body assembled from the stream instead, which parses back to +the same answer), and `http: Option` overrides the adapter's +own client. Set it at construction with `AnthropicModel::with_request_options` / `OpenAiModel::with_request_options`. On the OpenAI adapter it currently covers the Chat Completions path only (not the Responses/Codex path). diff --git a/vendor/tinyinference b/vendor/tinyinference index 3c4aa886c..e8156d1d4 160000 --- a/vendor/tinyinference +++ b/vendor/tinyinference @@ -1 +1 @@ -Subproject commit 3c4aa886c9348a71966ac1d6409ca6f17b04c29c +Subproject commit e8156d1d48a5fef0c787c6556adcdd8aff5ad266