Skip to content

docs: position the GitHub overview for agent workflows - #2522

Open
miyoungc wants to merge 14 commits into
developfrom
miyoungc/ngr-1020-guardrails-github-overview-update
Open

miyoungc wants to merge 14 commits into
developfrom
miyoungc/ngr-1020-guardrails-github-overview-update

Conversation

@miyoungc

@miyoungc miyoungc commented Oct 28, 2026 •

Copy link
Copy Markdown
Collaborator

Description

Position the GitHub overview around programmable safeguards for agents, with concise use cases for conversations, RAG, and model-provider APIs. Explain policy configuration, workflow checks, and application enforcement in three bullets. Consolidate capabilities into “Why NeMo Guardrails” and provide twelve linked catalog entries, named Nemotron Safety models, and garak evaluation guidance.

Keep the complete, package-based refund quickstart and all three historical community-usage charts in expandable sections. The quickstart prints the blocking rail and reason; the community snapshot retains its release/date scope, estimated counts, aggregate data, and methodology. Link detailed model, integration, and deployment instructions to the documentation.

Align Python requirements with the launch package (3.11–3.13), add security/release navigation, and remove the hard-coded release marker and its dependent workflow updater. The PR changes only README.md and .github/workflows/release.yml.

Preview: https://github.com/NVIDIA-NeMo/Guardrails/blob/miyoungc/ngr-1020-guardrails-github-overview-update/README.md

Related Issue(s)

The tracking issue is in Linear; there is no linked triaged GitHub issue.

Verification

  • Built 0.25.0rc1 from the updated branch and installed its [cel] extra with all runtime dependencies in a fresh Python 3.13 environment. Ran the exact README script outside the checkout with network connections prohibited. Output, blocking rail/reason, and seven additional policy/schema cases passed.
  • 154 focused checks-API and per-tool CEL tests passed. No live model/provider calls were made.
  • Verified 44 local links, image targets, and heading anchors, plus four published NVIDIA documentation URLs. Checked the community count, release scope, dates, and charts against the existing aggregate dataset and methodology.
  • uv run --locked pre-commit run --files README.md .github/workflows/release.yml and git diff --check passed.
  • make docs-fern generated 440 SDK reference pages and passed with 0 errors and 566 warnings. Used the existing cached SDK parser image after its remote image pull stalled; the cache override was local only.
  • GitHub Markdown rendering confirmed the two expandable sections, catalog table, and image links. The release action version comment was corrected to v8.1.1, matching its unchanged pinned hash.
  • Completed a source-backed editorial review for product positioning, supported use cases, activation/engine boundaries, execution ownership, package requirements, privacy, and metric provenance.

The package install flow targets publication with the 0.25.0 launch. Validation used the current release-candidate wheel, not a published GA package.

Source references

AI Assistance

Codex helped prepare the README and perform local verification. Human review is pending.

  • No AI tools were used.
  • AI tools were used; a human reviewed and can explain every change (tool: Codex).

Checklist

  • I've read the CONTRIBUTING guidelines.
  • This PR links to a triaged issue assigned to me.
  • My PR title follows the project commit convention.
  • I've updated the documentation if applicable.
  • I've added tests if applicable. The exact README example was checked in a fresh wheel installation, with policy/schema boundaries verified.
  • I've noted verification and any checks I couldn't run.
  • I did not update generated changelog files manually.
  • I addressed all CodeRabbit, Greptile, and other review comments, or replied with why no change is needed.
  • @mentions of the person or team responsible for reviewing proposed changes.

Summary by CodeRabbit

  • Documentation
    • Reworked the README to explain how applications can apply programmable safeguards for AI agents, including workflow checks and verdict enforcement.
    • Added a refund-tool example, deployment options, supported checks, limitations, and telemetry information.
    • Updated installation, contribution, and license references. The release process no longer updates the README’s release link.

Signed-off-by: Miyoung Choi <miyoungc@nvidia.com>
@github-actions github-actions Bot added status: needs triage New issues that have not yet been reviewed or categorized. size: M labels Oct 28, 2026
Signed-off-by: Miyoung Choi <miyoungc@nvidia.com>
Signed-off-by: Miyoung Choi <miyoungc@nvidia.com>
Signed-off-by: Miyoung Choi <miyoungc@nvidia.com>
@github-actions github-actions Bot added size: L and removed size: M labels Oct 29, 2026
Signed-off-by: Miyoung Choi <miyoungc@nvidia.com>
Signed-off-by: Miyoung Choi <miyoungc@nvidia.com>
Signed-off-by: Miyoung Choi <miyoungc@nvidia.com>
@miyoungc
miyoungc marked this pull request as ready for review October 30, 2026 19:43
Signed-off-by: Miyoung Choi <miyoungc@nvidia.com>
Signed-off-by: Miyoung Choi <miyoungc@nvidia.com>
@miyoungc miyoungc added status: in review status: triaged Triaged by a maintainer; eligible for automated review (CodeRabbit/Greptile). and removed status: needs triage New issues that have not yet been reviewed or categorized. labels Oct 30, 2026
@greptile-apps

greptile-apps Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

RetriggerView in GreptileConfidence Score: 5/5

[Low impact] The PR appears safe to merge for its intended 0.25.0 launch.

Summary

Reworks the README around agent workflows and removes the release workflow's README updater.

  • The README points agent builders to the checks that fit their apps.
  • The quickstart shows how an app checks a proposed refund before execution.
  • The README links guardrail choices to model and evaluation guides.
  • Community figures and support details move into shorter, easier-to-scan sections.
  • Release preparation stops rewriting the README's version link.

Reviews (6) · Last reviewed commit: "ci: correct the pinned release action ve..." · Reviewed by Greptile

Comment thread README.md Outdated
Third-party endpoints have separate terms and privacy practices. The NVIDIA NeMo Guardrails library can use inference endpoints such as NVIDIA Build (`build.nvidia.com`). If you use NVIDIA Build or another third-party endpoint, that endpoint's terms of service and privacy practices apply independently of the library. Any telemetry opt-out in the NVIDIA NeMo Guardrails library does not extend to the endpoint you choose. NVIDIA Build is intended for evaluation and testing only and must not be used in production environments. Do not submit confidential information or personal data when using NVIDIA Build.

## Inviting the community to contribute
Refer to [telemetry and privacy](https://docs.nvidia.com/nemo/guardrails/latest/resources/telemetry) for the full schema, local audit file, opt-out options, and third-party endpoint terms.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

P2 Promised privacy guidance is missing

The linked page only covers library telemetry; it does not contain the promised third-party endpoint terms. This PR also removes the README's explanation that third-party services have separate privacy terms and that the library's opt-out does not cover them. Readers following this link cannot find that guidance. Move it into the linked page or link to a page that contains it.

Prompt To Fix With AI
This is a comment left during a code review.
Path: README.md
Line: 253

Comment:
**Promised privacy guidance is missing**

The linked page only covers library telemetry; it does not contain the promised third-party endpoint terms. This PR also removes the README's explanation that third-party services have separate privacy terms and that the library's opt-out does not cover them. Readers following this link cannot find that guidance. Move it into the linked page or link to a page that contains it.

---

For each issue above, determine whether it is valid and should be fixed. If so, fix it directly.

Note: If this suggestion doesn't match your team's coding style, reply to this and let me know. I'll remember it for next time!

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This finding is outdated at the current PR head. The original wording was corrected in c88c161 and the relevant disclosure is retained in the current Telemetry and Privacy section.

The README no longer promises that the telemetry page contains third-party endpoint terms. It also explicitly states that the usage-telemetry opt-out does not disable configured model or guardrail service calls, and that those calls can send content to their endpoints.

The linked telemetry guide is now offered for telemetry details and opt-out options. The current README therefore addresses the missing disclosure and removes the inaccurate link promise. Please remove this already-addressed finding from the review summary.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Agreed. The current README has corrected the link’s scope and explicitly discloses that configured model or guardrail service calls can send content to their endpoints, regardless of the usage-telemetry opt-out. This finding is addressed and should be removed from the review summary.

@coderabbitai

coderabbitai Bot commented Oct 30, 2026 •

Copy link
Copy Markdown
Contributor

Review in Change Stack →

No actionable comments were generated in the recent review.

Recent review info
Run configuration
Commits

Reviewing files that changed from the base of the PR and between 731f6d0 and bec712d.

Files selected for processing: 2
  • .github/workflows/release.yml
  • README.md
Files with no reviewable changes: 1
  • .github/workflows/release.yml

Included review availability: This review used your included allowance. Your plan provides up to 12 included reviews per hour; 11 remain after this review.

Walkthrough

The README is rewritten around programmable safeguards for AI agents, with a new quickstart and updated deployment, check, telemetry, and project information. The release workflow no longer updates README release references; version, changelog, and lockfile updates remain.

Changes: Agent safeguards documentation

Layer / File(s) Summary
Project framing and release updates
README.md, .github/workflows/release.yml
The README introduces configurable checks for agent workflows and updates project links. The release workflow stops editing the README and removes the related pull request text and path entry.
Check workflow and quickstart
README.md
The README explains check verdicts and tool execution boundaries, then adds a refund-tool example using a CEL rule, check_async(), and IORails.
Deployment and check coverage
README.md
The README describes the HTTP proxy, coding-agent hooks, framework integration, check coverage, and supported engines.
Telemetry and project policies
README.md
The README shortens its telemetry description and updates contribution, license, and citation links.

Estimated code review effort: 2 (Simple) | ~10 minutes

Change: Other

Suggested labels: documentation

Suggested reviewers: pouyanpi

Merge Risk: Minimal · up to bec71

No actionable merge-blocking risk remains.

Pre-merge checks: Passed 5
Check name Status Explanation
Description Check Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Title check Passed The title clearly describes the main change: repositioning the GitHub README around agent workflows. The release workflow update is secondary.
Linked Issues check Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check Passed Check skipped because no linked issues were found for this pull request.
Test Results For Major Changes Passed The PR makes a substantial README and release-workflow documentation change. Its description includes testing information: a network-disabled quickstart run, seven policy and schema boundary checks, t…
Full details: Test Results For Major Changes

Explanation

The PR makes a substantial README and release-workflow documentation change. Its description includes testing information: a network-disabled quickstart run, seven policy and schema boundary checks, target and URL validation, pre-commit, diff, and documentation checks. No numeric, convergence, or performance change is introduced.

Finishing Touches
🧪 Generate unit tests (beta)
  • Commit to this branch
  • Create a new PR
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Comment @coderabbitai help to get the list of available commands.

Signed-off-by: Miyoung Choi <miyoungc@nvidia.com>

@tgasser-nv tgasser-nv left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for the PR @miyoungc. This has good coverage of agentic use-cases, but is missing all the other capabilities of Guardrails. We still support a range of rails for conversational, RAG, etc. We need to add these into the README as well.

Recommend adding a section at the top with all the use-cases we support including conversational application with input and output rails, RAG, etc. Then each of these can link to a more detailed section below with further information. The PR as it is will be good for agentic / tool-calling usecases

Signed-off-by: Miyoung Choi <miyoungc@nvidia.com>
Signed-off-by: Miyoung Choi <miyoungc@nvidia.com>
Comment thread README.md Resolved
Comment thread README.md
Comment on lines +23 to +25
- **AI agents and coding assistants:** Check proposed tool calls and returned results with [tool rails](./docs/configure-rails/guardrail-catalog/tool-calling.mdx), or connect an agent through the [hooks server](./docs/run-rails/using-hooks-server/index.mdx).
- **Conversational applications:** Apply [input and output checks](./docs/run-rails/using-python-apis/check-messages.mdx) and define dialog behavior with [Colang](./docs/configure-rails/colang/index.mdx).
- **Retrieval-augmented generation (RAG):** [Detect or mask sensitive data in retrieved content](./docs/configure-rails/guardrail-catalog/pii-detection.mdx) and [check whether answers are grounded in evidence](./docs/configure-rails/guardrail-catalog/fact-checking.mdx).

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

shall we add ?
guardrailing/securing model provider API's through the serveror the experimental guardrails proxy

Comment thread README.md
- [Security Guidelines](https://docs.nvidia.com/nemo/guardrails/security/guidelines.html)
Use the [evaluation tools](https://docs.nvidia.com/nemo/guardrails/latest/evaluation) to assess your policies and [garak](https://github.com/NVIDIA/garak) to scan LLM applications for vulnerabilities. Refer to the [vulnerability-scanning guide](./docs/evaluation/llm-vulnerability-scanning.mdx) for an example.

## Telemetry and Privacy

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I’m not sure whether the requirements have changed, but the original decision was to include these telemetry metrics in the README as a way of giving back to the community.

Signed-off-by: Miyoung Choi <miyoungc@nvidia.com>
Signed-off-by: Miyoung Choi <miyoungc@nvidia.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size: L status: in review status: triaged Triaged by a maintainer; eligible for automated review (CodeRabbit/Greptile).

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants