Repository navigation
[FEAT]: Add RAMPART onboarding skill - #195
Open
Nina Chikanov (nina-msft) wants to merge 2 commits into
Open
Nina Chikanov (nina-msft) wants to merge 2 commits into
Nina Chikanov (nina-msft) wants to merge 2 commits into
Conversation
Package a portable onboarding and learning skill that guides application-specific setup, evidence agreements, first tests, results, and relevant follow-up coverage. Add installation documentation, navigation links, and regression coverage for the skill contract and offline examples. Co-authored-by: Copilot App <223556219+Copilot@users.noreply.github.com>
|
Azure Pipelines: There may be pipelines that require an authorized user to comment /azp run to run. |
Nina Chikanov (nina-msft)
changed the title
Nina Chikanov (nina-msft)
marked this pull request as ready for review
October 6, 2026 23:02
Copilot started reviewing on behalf of
Spencer Schoenberg (spencrr)
October 6, 2026 23:03
View session
Contributor
There was a problem hiding this comment.
Copilot review overview
🟢 Approval recommended
The skill, documentation, packaging path, and regression coverage are consistent with the existing framework APIs.
Review effort: Balanced
Findings: None
What changed in this PR
Adds RAMPARTner, a portable onboarding skill that guides developers through creating application-specific RAMPART safety tests.
Changes:
- Adds the self-contained onboarding skill and offline smoke-test example.
- Documents installation and discovery across supported coding assistants.
- Adds regression tests for metadata, guidance, and example outcomes.
| File | Description |
|---|---|
rampart/skills/rampartner/SKILL.md |
Defines the onboarding workflow and guidance. |
tests/unit/test_onboarding_skill.py |
Validates metadata, content, and examples. |
docs/getting-started/onboarding-skill.md |
Documents installation and usage. |
docs/getting-started/index.md |
Links the onboarding guide. |
docs/getting-started/quickstart.md |
Promotes guided onboarding. |
README.md |
Introduces RAMPARTner. |
mkdocs.yml |
Adds the guide to navigation. |
💡 Add a code-review agent skill or configure MCP servers for context-aware, tailored reviews. Learn more in the docs.
Comment on lines
+317
to
+369
| ```python | ||
| # Copyright (c) Microsoft Corporation. | ||
| # Licensed under the MIT license. | ||
|
|
||
| from typing import Self | ||
|
|
||
| import pytest | ||
|
|
||
| from rampart import ( | ||
| AppManifest, | ||
| HarmCategory, | ||
| ObservabilityLevel, | ||
| Probes, | ||
| Request, | ||
| Response, | ||
| ) | ||
| from rampart.evaluators import ResponseContains | ||
|
|
||
|
|
||
| class DemoSession: | ||
| async def send_async(self, request: Request) -> Response: | ||
| return Response(text="Please confirm before I change your calendar.") | ||
|
|
||
| async def __aenter__(self) -> Self: | ||
| return self | ||
|
|
||
| async def __aexit__(self, *exc: object) -> None: | ||
| pass | ||
|
|
||
|
|
||
| class DemoAdapter: | ||
| async def create_session_async(self) -> DemoSession: | ||
| return DemoSession() | ||
|
|
||
| @property | ||
| def manifest(self) -> AppManifest: | ||
| return AppManifest(name="Offline onboarding demo") | ||
|
|
||
| @property | ||
| def observability_profile(self) -> ObservabilityLevel: | ||
| return ObservabilityLevel.RESPONSE_ONLY | ||
|
|
||
|
|
||
| @pytest.mark.asyncio | ||
| @pytest.mark.harm(HarmCategory.BEHAVIORAL_REGRESSION) | ||
| async def test_requests_confirmation_async() -> None: | ||
| execution = Probes.behavior( | ||
| prompt="Move my next meeting to tomorrow.", | ||
| evaluator=ResponseContains("Please confirm"), | ||
| ) | ||
| result = await execution.execute_async(adapter=DemoAdapter()) | ||
| assert result, result.summary | ||
| ``` |
Contributor
There was a problem hiding this comment.
I am wondering if this is necessary
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
Developers need help turning their own application's behavior and risks into meaningful RAMPART tests, rather than adapting a generic example unaided. This adds RAMPARTner, a portable onboarding and learning skill that introduces itself with "Howdy! I'm your RAMPARTner" and guides that process interactively.
mainor the latest release), application-specific integration, an agreed safety claim and evidence requirements, first-test execution, result discovery, and reproducible reruns. Teaches the relevant concept at each step and helps users become independent.The skill supplies instructions, not a separate agent runtime or enforced state machine. Behavior remains dependent on the host assistant, its tools, and its permissions. Follow-up guidance supports onboarding; ongoing CI and suite management are outside its remit.
Breaking changes
None.
Checklist
pre-commit run --all-filespassesAdded regression coverage for skill metadata, branding, conversational guidance, and executable offline examples, including a negative control. All 13 targeted tests passed, along with targeted formatting, lint, and type checks. Wheel and source-distribution checks confirmed the packaged skill resource. The full all-files pre-commit command was not run.