Repository navigation
ci: Track release pipeline failures and stuck releases in an issue - #138
Merged
Merged
Conversation
Co-Authored-By: BYK <126780+BYK@users.noreply.github.com>
sentry-junior
Bot
requested review from
BYK,
MathurAditya724 and
betegon
as code owners
November 9, 2026 16:43
BYK
approved these changes
Nov 9, 2026
2 tasks done
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
From 11-07 to 11-09,
@sentry/apididn't release for 2 days and nobody noticed. Build was red onmain, and every Release run failed on the stalerelease/1.52.0branch, but nothing reported it. Releases can also get stuck with no failing run at all. 83a2b74, for example, landed while 1.52.0 was pending and sat unreleased.This PR adds a
Release pipeline healthworkflow. It keeps one issue, "Release pipeline failing on main", open while the pipeline is broken.Failure alerts.
main, the workflow opens the issue, or comments on it if it's already open.Recovery.
Daily staleness check. At 08:23 UTC, and on manual dispatch, the workflow reports to the same issue in either of these cases:
mainthat isn't in the newest npm release is more than 24h old. The newest npm release comes fromnpm view @sentry/api version, matched to its git tag. A missing tag is reported too.ci-failedfor more than 24h, counted from when the label was added.The first check measures how long a schema commit has been waiting. A commit that landed 1h after a long quiet stretch doesn't trigger it. A commit stranded a minute after a release, like 83a2b74, still does.
The workflow uses the default
GITHUB_TOKENwithcontents: readandissues: write. getsentry/publish is public, so that token can read its issues and their events. No new secrets, no Slack.Testing
I ran both scripts under
dash.Staleness check on real data:
mainis reported as up to date.Stubbed runs:
ci-failedrequest older than 24h is reported. A newer one, and requests for other repos, are not.npm, the issue list, or the events fetch fails, the run fails.actionlintandshellcheck --shell=sh --enable=check-extra-masked-returnspass.No UI changes, so no screenshots.
Notes
via @BYK.
--
View Session in Sentry