Skip to content

Improve chat model observations#5962

Open
ThomasVitale wants to merge 1 commit intospring-projects:mainfrom
ThomasVitale:improve-chat-model-observations
Open

Improve chat model observations#5962
ThomasVitale wants to merge 1 commit intospring-projects:mainfrom
ThomasVitale:improve-chat-model-observations

Conversation

@ThomasVitale
Copy link
Copy Markdown
Contributor

  • Add gen_ai.request.stream attribute indicating whether the request was made in streaming mode.
  • Add provider cache token usage tracking via gen_ai.usage.cache_creation.input_tokens and gen_ai.usage.cache_read.input_tokens attributes.
  • Update observability documentation.

@ThomasVitale
Copy link
Copy Markdown
Contributor Author

@tzolov as discussed, I added some extra attributes to the chat model observations and also took the chance to update the observability documentation since it was still containing deprecations from before 1.0.0.

* Add gen_ai.request.stream attribute indicating whether the request was made in streaming mode.
* Add provider cache token usage tracking via gen_ai.usage.cache_creation.input_tokens and gen_ai.usage.cache_read.input_tokens attributes.
* Update observability documentation.

Signed-off-by: Thomas Vitale <ThomasVitale@users.noreply.github.com>
@ThomasVitale ThomasVitale force-pushed the improve-chat-model-observations branch from fa796c4 to 07955e2 Compare May 6, 2026 20:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant