Skip to content

test(langchain): record langsmith and bedrock mantle partner chat providers in drift snapshot - #2589

Merged
Pouyanpi merged 1 commit into
developfrom
pouyanpi/fix-latest-deps-ci
Nov 11, 2026
Merged

Pouyanpi merged 1 commit into
developfrom
pouyanpi/fix-latest-deps-ci

Conversation

@Pouyanpi

@Pouyanpi Pouyanpi commented Nov 10, 2026 •

Copy link
Copy Markdown
Collaborator

Description

The scheduled "Test with Latest Dependencies" job has failed since 2026-08-18 on the test_langchain_provider_drift canary. Newer langchain releases added three partner chat providers to _BUILTIN_PROVIDERS, so the discovered set drifted from the snapshot recorded at langchain 1.3.13 (added=['bedrock_mantle_anthropic', 'bedrock_mantle_openai', 'langsmith'], removed=[]).

These are upstream additions with nothing removed, so this regenerates the langchain-community 0.4 snapshot entry via update_provider_snapshot.py with langchain 1.4.8 installed:

  • langchain_version: 1.3.13 -> 1.4.8
  • partner_chat_providers: add bedrock_mantle_anthropic, bedrock_mantle_openai, langsmith

The 0.3 series entry and uv.lock are unchanged.

Related Issue(s)

Failing run: https://github.com/NVIDIA-NeMo/Guardrails/actions/runs/42707955810

Verification

  • workflow is green https://github.com/NVIDIA-NeMo/Guardrails/actions/runs/42854698810
  • LANGCHAIN_PROVIDER_DRIFT_CHECK=1 with langchain 1.4.8: tests/integrations/langchain/llm/test_version_compatibility.py 14 passed.
  • Locked environment: make test TEST=tests/integrations/langchain/llm/test_version_compatibility.py 13 passed, 1 skipped (canary is skipped outside the latest-deps job).
  • Pre-commit passed on the changed file.

Not covered: the Windows / Python 3.12 job in the failing run also hit a TimeoutError in tests/server/experimental/test_guardrails_startup_cleanup.py::test_application_retains_failed_startup_until_cleanup_finishes[timeout-raise]. It passed on the other Windows jobs and is not addressed here.

Summary by CodeRabbit

  • New Features
    • LangChain integration provider coverage now includes Bedrock Mantle Anthropic, Bedrock Mantle OpenAI, and LangSmith. These providers are now represented in the supported provider snapshot.

…viders in drift snapshot

The scheduled latest-deps job has failed on test_langchain_provider_drift
since langchain added the langsmith, bedrock_mantle_anthropic and
bedrock_mantle_openai partner chat providers. These are upstream additions
with nothing removed, so regenerate the langchain-community 0.4 snapshot
entry with update_provider_snapshot.py at langchain 1.4.8.

Signed-off-by: Pouyanpi <13303554+Pouyanpi@users.noreply.github.com>
@github-actions github-actions Bot added status: needs triage New issues that have not yet been reviewed or categorized. size: XS labels Nov 10, 2026
@Pouyanpi Pouyanpi changed the title test(langchain): record langsmith and bedrock mantle partner chat pro… test(langchain): record langsmith and bedrock mantle partner chat providers in drift snapshot Nov 10, 2026
@Pouyanpi Pouyanpi added status: triaged Triaged by a maintainer; eligible for automated review (CodeRabbit/Greptile). and removed status: needs triage New issues that have not yet been reviewed or categorized. labels Nov 10, 2026
@Pouyanpi Pouyanpi self-assigned this Nov 10, 2026
@Pouyanpi Pouyanpi added this to the v0.25.0 milestone Nov 10, 2026
@coderabbitai

coderabbitai Bot commented Nov 10, 2026 •

Copy link
Copy Markdown
Contributor

Explain Change →

No actionable comments were generated in the recent review.

Walkthrough

The LangChain provider snapshot updates its version from 1.3.13 to 1.4.8 and adds three entries to the partner chat provider list.

Changes: LangChain provider snapshot

Layer / File(s) Summary
Update snapshot version and providers
tests/integrations/langchain/llm/langchain_provider_snapshot.json
The snapshot changes langchain_version to 1.4.8. The partner_chat_providers list adds bedrock_mantle_anthropic, bedrock_mantle_openai, and langsmith.

Estimated code review effort: 1 (Trivial) | ~5 minutes

Change: Other

Suggested reviewers: tanushriya910

Merge Risk: Minimal · up to 573d1

No merge-blocking risk is identified in the snapshot update.

Architecture risk: Low · up to 573d1

The change affects 1 system.

Changed systems: tests

Architecture concerns
No architecture-level concerns identified.

Review details

Systems and components

  • observed — tests (service) was modified; 1 changed file maps to changed impact.

Before / after behavior

  • observed — Modified behavior in tests/integrations/langchain/llm/langchain_provider_snapshot.json: The 0.4 snapshot’s langchain_version changes from 1.3.13 to 1.4.8.
  • observed — Modified behavior in tests/integrations/langchain/llm/langchain_provider_snapshot.json: The partner_chat_providers list adds bedrock_mantle_anthropic and bedrock_mantle_openai.
  • observed — Modified behavior in tests/integrations/langchain/llm/langchain_provider_snapshot.json: The partner_chat_providers list adds langsmith.
Pre-merge checks: Passed 5

Check name Status Explanation
Description Check Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check Passed The title clearly describes the main change: recording LangSmith and Bedrock Mantle providers in the LangChain drift snapshot.
Linked Issues check Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check Passed Check skipped because no linked issues were found for this pull request.
Test Results For Major Changes Passed The PR makes a minor change to a provider drift test snapshot. It does not change numerical, convergence, or production performance behavior. The PR description also reports test results for the lates…
Full details: Test Results For Major Changes

Explanation

The PR makes a minor change to a provider drift test snapshot. It does not change numerical, convergence, or production performance behavior. The PR description also reports test results for the latest-dependencies and locked environments.

Finishing Touches

Generate unit tests (beta)

  • Commit to this branch
  • Create a new PR
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts
Recent review info

Run configuration

Commits

Reviewing files that changed from the base of the PR and between 537fd77 and 573d1cb.

Files selected for processing: 1

  • tests/integrations/langchain/llm/langchain_provider_snapshot.json

Included review availability: This review used your included allowance. Your plan provides up to 12 included reviews per hour; 9 remain after this review.

@Pouyanpi

Copy link
Copy Markdown
Collaborator Author

@greptile review this PR

@greptile-apps

greptile-apps Bot commented Nov 10, 2026 •

Copy link
Copy Markdown
Contributor

RetriggerView in GreptileConfidence Score: 5/5

[Low impact] This snapshot update appears safe to merge.

Summary

Updates the test snapshot for the 0.4 series of langchain-community.

  • The LangChain 0.4 snapshot now lists three added partner chat providers.

Reviews (2) · Last reviewed commit: "test(langchain): record langsmith and be..." · Reviewed by Greptile

@Pouyanpi
Pouyanpi merged commit 093ae1f into develop Nov 11, 2026
40 of 41 checks passed
@Pouyanpi
Pouyanpi deleted the pouyanpi/fix-latest-deps-ci branch November 11, 2026 09:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size: XS status: triaged Triaged by a maintainer; eligible for automated review (CodeRabbit/Greptile).

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant