Skip to content

docs(decisions): questions and Rerank.decide take an image in a blob property - #2204

Draft
jfrancoa wants to merge 3 commits into
jose/rerank-decide-clientfrom
jose/decisions-images-client
Draft

jfrancoa wants to merge 3 commits into
jose/rerank-decide-clientfrom
jose/decisions-images-client

Conversation

@jfrancoa

@jfrancoa jfrancoa commented Oct 13, 2026 •

Copy link
Copy Markdown
Contributor

What

decisions-openai judges images on the server (weaviate/weaviate#13534): a question of decide= or a rerank=Rerank.decide(...) about a blob property sends the image to the Decisions API. The client needs no code change: Decision.predicate/choice/score(prop=...) and Rerank.decide(prop=...) take the blob property as they take a text one. This PR updates the docstrings, adds Configure.Decisions.typesafeai(images=True), the opt-in for decisions-typesafeai to judge blob properties as images (weaviate/weaviate#13543; image input is an experimental feature of the TypeSafe AI API, off by default), and adds an integration test on decisions-dummy, which judges a blob as the text of its base64 (a probability of 0 for an object with a photo, a refusal for an object without one).

res = cars.query.near_text("rear bumper", limit=20, decide=[
    Decision.predicate("damaged", prop="photo", instructions="Does the car have visible damage?"),
])
res = cars.query.near_text("rear bumper", limit=20,
    rerank=Rerank.decide(prop="photo", query="The car has visible damage.", min_probability=0.6))

Stacked on #2198.

@orca-security-eu orca-security-eu Bot left a comment •

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Orca Security Scan Summary

Status Check Issues by priority
Passed Passed Secrets high 0   medium 0   low 0   info 0 View in Orca

@codecov-commenter

codecov-commenter commented Oct 13, 2026 •

Copy link
Copy Markdown

Codecov Report

❌ Patch coverage is 41.66667% with 7 lines in your changes missing coverage. Please review.
⚠️ Please upload report for BASE (jose/rerank-decide-client@ee66137). Learn more about missing BASE report.

Files with missing lines Patch % Lines
integration/test_collection_decisions.py 41.66% 7 Missing ⚠️
Additional details and impacted files
@@                     Coverage Diff                      @@
##             jose/rerank-decide-client    #2204   +/-   ##
============================================================
  Coverage                             ?   88.73%           
============================================================
  Files                                ?      310           
  Lines                                ?    24817           
  Branches                             ?        0           
============================================================
  Hits                                 ?    22022           
  Misses                               ?     2795           
  Partials                             ?        0           

☔ View full report in Codecov by Harness.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@jfrancoa
jfrancoa force-pushed the jose/decisions-images-client branch 2 times, most recently from 443e434 to d7d329f Compare October 14, 2026 11:22
@jfrancoa jfrancoa changed the title docs(decisions): questions and Decide take an image in a blob property docs(decisions): questions and Rerank.decide take an image in a blob property Oct 14, 2026
@jfrancoa
jfrancoa force-pushed the jose/decisions-images-client branch from d7d329f to c0aa4f3 Compare October 14, 2026 12:47
@jfrancoa
jfrancoa requested a balanced review from Copilot October 14, 2026 12:48

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

The documentation matches the server behavior, and the integration test covers the relevant client paths.

0 open findings

What changed in this PR

Updates client documentation and integration coverage for decisions over image blobs.

Changes:

  • Documents blob-image support for decision questions and reranking.
  • Adds integration coverage for blob decisions and refusal behavior.
File Description
weaviate/​collections/​classes/​grpc.py Clarifies image-capable property support.
integration/​test_collection_decisions.py Tests decisions and reranking on blobs.

🧠 Review effort: Balanced


💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.

@jfrancoa
jfrancoa force-pushed the jose/decisions-images-client branch from c0aa4f3 to d45473d Compare October 14, 2026 13:14
@jfrancoa
jfrancoa force-pushed the jose/decisions-images-client branch from d45473d to 7264a36 Compare October 14, 2026 13:46
@jfrancoa
jfrancoa requested a balanced review from Copilot October 14, 2026 13:49

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🟢 Approval recommended

The documentation matches server behavior, and the integration test covers both affected query paths.

0 open findings

🧠 Review effort: Balanced

The decisions-typesafeai module judges blob properties as images when the
collection opts in (weaviate/weaviate: the images class setting). Off by
default: image input is an experimental feature of the TypeSafe AI API.

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants