Repository navigation
feat(metrics): bootstrap phase stages, live gate progress, hourly config log - #314
Open
harshil-goel wants to merge 1 commit into
Open
harshil-goel wants to merge 1 commit into
harshil-goel wants to merge 1 commit into
Conversation
harshil-goel
force-pushed
the
harshil/bootstrap-stage-metrics
branch
from
November 10, 2026 20:23
e52aec3 to
14dae62
Compare
harshil-goel
force-pushed
the
harshil/bootstrap-stage-metrics
branch
from
November 10, 2026 21:31
14dae62 to
e22afb6
Compare
harshil-goel
force-pushed
the
harshil/bootstrap-stage-metrics
branch
from
November 11, 2026 07:26
e22afb6 to
faa2eec
Compare
harshil-goel
force-pushed
the
harshil/bootstrap-stage-metrics
branch
from
November 11, 2026 07:48
faa2eec to
2404a68
Compare
harshil-goel
force-pushed
the
harshil/bootstrap-stage-metrics
branch
from
November 11, 2026 08:58
2404a68 to
51cc8a3
Compare
harshil-goel
force-pushed
the
harshil/bootstrap-stage-metrics
branch
from
November 11, 2026 09:32
51cc8a3 to
d9b6ad6
Compare
harshil-goel
force-pushed
the
harshil/bootstrap-stage-metrics
branch
from
November 11, 2026 09:45
d9b6ad6 to
13dcc8f
Compare
harshil-goel
force-pushed
the
harshil/bootstrap-stage-metrics
branch
from
November 11, 2026 11:38
13dcc8f to
f46da85
Compare
harshil-goel
force-pushed
the
harshil/bootstrap-stage-metrics
branch
2 times, most recently
from
November 17, 2026 16:15
10be5c7 to
8adf3f5
Compare
harshil-goel
force-pushed
the
harshil/bootstrap-stage-metrics
branch
from
November 18, 2026 05:11
8adf3f5 to
e5f5037
Compare
harshil-goel
force-pushed
the
harshil/bootstrap-stage-metrics
branch
from
November 18, 2026 08:13
e5f5037 to
db3d37e
Compare
harshil-goel
force-pushed
the
harshil/bootstrap-stage-metrics
branch
from
November 18, 2026 08:45
db3d37e to
4ffd115
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
Bootstrap phases as stages, live progress for each, and a config log.
bootstrap,bootstrap_walk,bootstrap_window,shadow_replay,bootstrap_deferred,bootstrap_gate. Everywalshadow_stage_*series carriestitle(operator name) andorder(running order, spaced by 10).walshadow_stage_progress{stage,title,order,measure}:work_total,work_done,rows. Values only rise,work_donelands onwork_totalwhen the stage completes, and nothing is published by a daemon that never bootstrapped. Units: backup parts for the walk, spool bytes for the large-value fill, deferred tuples for the visibility check.walshadow_bootstrap_gate_tuples_total{verdict}:emitted,gated,deferred,pending, counted live. A deferred tuple is counted again under its final verdict.walshadow_source_mode{mode="initial_load"}is set for the whole bootstrap.walshadow::config: per source database oneshadow configline, then onetable configline per table. No secrets: endpoint ishost:port/dbname.bootstrap_windowcovers both ways the window is replayed: live beside the walk, or from the landed WAL after it.bootstrap_walkends when the walk and its inserts drain, and is not started on a resumed attempt.Breaking
walshadow_bootstrap_gate_emitted_total,_gated_total,_deferred_totalare removed. Usewalshadow_bootstrap_gate_tuples_total{verdict}.PromQL
Tests
work_and_rows_are_absent_until_set,work_only_rises_and_lands_on_total_at_completionlock_only_multixact_rows_emit_and_countasserts the live gate countersStacked on #256.