You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Propose jumpstarter-overdrive (alternative name: jumpstarter-tempest), an opt-in Python scale/performance testing tool for existing and disposable Jumpstarter clusters.
Phase 1 — JEP-0019: standalone Python tool
Independent lease-scheduling, client-churn, exporter-churn, and router-traffic scenarios.
Per-scenario load ranges and timing, using real protocol paths and runner-managed mock exporters.
Controller/router CPU, memory, and network collection, with preliminary report examples.
Small implementation increments: runner and lease scheduling first, additional scenarios next, then resource collection and readable reports.
No controller, operator, CRD, or provisioner changes; no Phase 2 scaffolding required.
Phase 2 — JEP-0020: separate extension work
A separate JEP referencing JEP-0019 defines the opt-in mock ExporterSet provisioner and scaling scenario.
Reuses the completed runner, metrics collector, and reporting to exercise the real ExporterSet framework without real target provisioning.
Includes ExporterSet controller metrics and scaling-specific acceptance criteria.
Not a prerequisite or acceptance criterion for Phase 1: the initial tool can ship independently.
Both design documents are included here; implementation is not part of this PR.
Validation
Validated required sections, local links, YAML/JSON/Python example syntax, aligned load ranges, and example throughput arithmetic.
Confirmed the Phase 1 configuration excludes the mock provisioner and ExporterSet scenario.
Staged whitespace checks passed.
A documentation build during initial drafting failed on an unrelated local, untracked document: docs/source/introduction/exporter-fsm-diagram.md is not included in a toctree. That file is not part of this PR.
No actionable comments were generated in the recent review.
Walkthrough
The change adds two draft JEPs proposing a standalone scale-testing tool and an opt-in ExporterSet testing extension. The JEP index adds entries and links for both proposals.
JEP-0019 proposes a standalone tool with four initial scenarios, load-sweep rules, measurement and reporting formats, and validation requirements. It separates ExporterSet testing into Phase 2.
Define the ExporterSet extension docs/source/contributing/jeps/JEP-0020-mock-exporterset-performance-testing.md
JEP-0020 proposes an opt-in mock provisioner and an exporterset-scaling scenario. It describes the extension as separate follow-up work that uses the existing provisioner interface.
Describe Phase 2 operation and publish both JEPs docs/source/contributing/jeps/JEP-0020-mock-exporterset-performance-testing.md, docs/source/contributing/jeps/index.md
JEP-0020 specifies the proposed test flow, measurements, cleanup, and validation. The index adds Draft entries and links for both JEPs.
This change adds two draft proposals for scale and performance testing, plus their index entries. It does not change runtime behavior. No merge-blocking issues remain.
Pre-merge checks: 4
Check name
Status
Explanation
Title check
The title names both JEP documents added by this PR (JEP-0019 and JEP-0020) and the topic they address, scale testing. It is short and specific. It does not name the tool or the phase split, but it ac…
Description check
The description states the purpose of the PR: two design documents (JEP-0019 and JEP-0020) for the jumpstarter-overdrive scale and performance testing tool. It lists the Phase 1 and Phase 2 scope, the…
Linked Issues check
Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check
Check skipped because no linked issues were found for this pull request.
Full details: Title check
Explanation
The title names both JEP documents added by this PR (JEP-0019 and JEP-0020) and the topic they address, scale testing. It is short and specific. It does not name the tool or the phase split, but it accurately covers the main change, which is two design documents for scale and performance testing.
Full details: Description check
Explanation
The description states the purpose of the PR: two design documents (JEP-0019 and JEP-0020) for the jumpstarter-overdrive scale and performance testing tool. It lists the Phase 1 and Phase 2 scope, the validation performed, and notes that implementation is not part of the PR. It matches the changeset closely.
Finishing Touches
Generate unit tests (beta)
Create a new PR
Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.
A rabbit reads the JEPs at dawn, And nibbles through each testing plan. Mock pods hop into the scaling scene, While metrics mark what steps have been. Two drafts now join the index row, Then off through clover paths we go!
Recent review info
Run configuration
Source mode: Auto
Repository: Unavailable
Branch: Unavailable
File: No configuration file from this repository applied
Commit: Unavailable
Layers: Organization UI
Review profile: CHILL
Plan: Advanced
Run ID: 61d326f8-2043-4f6e-bf31-39ca0e70f747
Commits
Reviewing files that changed from the base of the PR and between 27ec21e and de3e1f7.
Included review availability: This review used your included allowance. Your plan provides up to 2 included reviews per hour; 1 remain after this review.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Propose jumpstarter-overdrive (alternative name: jumpstarter-tempest), an opt-in Python scale/performance testing tool for existing and disposable Jumpstarter clusters.
Phase 1 — JEP-0019: standalone Python tool
Phase 2 — JEP-0020: separate extension work
Both design documents are included here; implementation is not part of this PR.
Validation