Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
122 commits
Select commit Hold shift + click to select a range
bb8e041
loom cell attach turns a prepared first cell into a serving one; prep…
zlareb1 Nov 16, 2026
1f05935
Attach's runbook, the cells.md first-attach steps and the trigger-cos…
zlareb1 Nov 16, 2026
55c0918
The widened heartbeat window lives with attach, so server.core import…
zlareb1 Nov 16, 2026
4a7bc88
ensure_table's integration test lands with attach, its caller
zlareb1 Nov 16, 2026
4193ffd
Fix a double space in the failure table's pooler row
zlareb1 Nov 16, 2026
c650119
Attach refuses a table its role cannot alter up front, charges --wait…
zlareb1 Nov 16, 2026
5884b04
Doctor's stray-org read names a table it cannot read and goes on, and…
zlareb1 Nov 16, 2026
691f4f0
Attach's closing line names the mode it last read, every DDL try ends…
zlareb1 Nov 16, 2026
4a25c41
The attach docs say which role attach exempts, and the trigger gate's…
zlareb1 Nov 16, 2026
0c37c68
Every attach try runs once whatever --wait has left, the mode reads u…
zlareb1 Nov 16, 2026
07f9ea1
The attach docs say what --wait 0 does, and cells.md keeps each code …
zlareb1 Nov 16, 2026
78c2808
Bound cell attach's mode commit and name booting processes
zlareb1 Nov 16, 2026
62c6b47
Require every cell probe grant before attach
zlareb1 Nov 16, 2026
95bb74c
Keep cell attach deadlines from waiting on rollback
zlareb1 Nov 16, 2026
d5ec3b9
Bound attach trigger attempts and scope gate cleanup to its run
zlareb1 Nov 16, 2026
20681aa
Check member-role privileges and repeat attach checks after placement
zlareb1 Nov 16, 2026
cb95fff
Require effective predefined role privileges before attach
zlareb1 Nov 16, 2026
fde3798
Describe the effective owner privileges attach requires
zlareb1 Nov 16, 2026
cad839b
Build placement indexes outside migration transactions
zlareb1 Nov 16, 2026
cc4ed54
Fence cell control mutations across local lock loss
zlareb1 Nov 16, 2026
e0f756b
Index cell control recovery and its upgrade refusal
zlareb1 Nov 16, 2026
3f62dfd
Validate the cell name before recovery requests
zlareb1 Nov 16, 2026
db89cb2
Keep attaching cells closed through state cleanup
zlareb1 Nov 16, 2026
4380186
Build placement indexes outside migration transactions
zlareb1 Nov 16, 2026
417712d
Close owned Postgres sessions before cancelling their work
zlareb1 Nov 16, 2026
c601646
Close owned Postgres sessions before cancelling their work
zlareb1 Nov 16, 2026
51a8ff6
Close attach sessions before cancelling transaction work
zlareb1 Nov 16, 2026
1f69c41
Supervise native cell control cleanup before cancelling work
zlareb1 Nov 16, 2026
5f76257
Close attach sessions before cancelling transaction work
zlareb1 Nov 16, 2026
f4702f6
Use one owner for native cell control sessions
zlareb1 Nov 16, 2026
f9986b5
Propagate unexpected trigger errors before rollback cleanup
zlareb1 Nov 16, 2026
5a62070
Propagate unexpected trigger errors before rollback cleanup
zlareb1 Nov 16, 2026
deacbaa
Close directory control sessions before cancelling their work
zlareb1 Nov 17, 2026
0c10636
Measure cell triggers with the original API and delivery workload
zlareb1 Nov 17, 2026
459dc34
Fix control batch bounds and schema coexistence checks
zlareb1 Nov 17, 2026
9caeb23
Preserve native migration failures through owned cleanup
zlareb1 Nov 17, 2026
d71bfc9
Preserve native migration failures through owned cleanup
zlareb1 Nov 17, 2026
92d6d9b
Use common fatal transport for directory session close
zlareb1 Nov 17, 2026
a13eb96
Construct migration cleanup work inside its error capture
zlareb1 Nov 17, 2026
0410333
Validate serving configuration and serialize fresh delivery rows
zlareb1 Nov 17, 2026
8c03200
Construct migration cleanup work inside its error capture
zlareb1 Nov 17, 2026
8018e30
Keep attach cleanup inside its owning deadline
zlareb1 Nov 17, 2026
6a1d018
Compose shared directory cleanup and foreground pool initialization
zlareb1 Nov 17, 2026
cdce8ec
Keep owned cancellation alive through repeated signals
zlareb1 Nov 17, 2026
70c21f2
Migration fallback aborts preserve the first failure
zlareb1 Nov 17, 2026
9d18614
Keep owned cancellation alive through repeated signals
zlareb1 Nov 17, 2026
0835f33
Migration fallback aborts preserve the first failure
zlareb1 Nov 17, 2026
723109d
Compose native control ownership with bounded abort cleanup
zlareb1 Nov 17, 2026
f378a28
Match persisted vector precision and preserve attach cleanup errors
zlareb1 Nov 17, 2026
9dd0934
WIP: Preserve selected driver errors through artifact diagnostics
zlareb1 Nov 17, 2026
15f842a
Preserve artifact sync failures through file close
zlareb1 Nov 17, 2026
a9580c1
The cell trigger driver retains its first failure through cleanup
zlareb1 Nov 17, 2026
2ff8931
Describe trigger creation before the attach mode commit
zlareb1 Nov 17, 2026
e8b9d6a
WIP: Compose attach checks with native cell control
zlareb1 Nov 17, 2026
69e9f2d
Exercise attach cleanup with a fenced directory snapshot
zlareb1 Nov 17, 2026
01621af
Check trigger gate provenance in its repository checkout
zlareb1 Nov 17, 2026
5d04387
Check trigger gate provenance in its repository checkout
zlareb1 Nov 17, 2026
dfa83dd
Preserve native control request failures through HTTP cleanup
zlareb1 Nov 17, 2026
6f61b36
Retire participants only after permanent quiescence
zlareb1 Nov 16, 2026
5db501c
Hold native principal work through command retirement
zlareb1 Nov 16, 2026
6badd7d
Check the participant identity in cell heartbeat tests
zlareb1 Nov 17, 2026
06355a3
Bind trigger timing receipts to distinct API and CLI configurations
zlareb1 Nov 17, 2026
c884dd1
Preserve native errors through nonce cleanup
zlareb1 Nov 17, 2026
46aa499
Compose permanent retirement with fenced cell controls
zlareb1 Nov 17, 2026
d62fdaa
Merge certified participant retirement into cell attachment
zlareb1 Nov 17, 2026
0a94de8
Native commands preserve their first failure through cleanup
zlareb1 Nov 17, 2026
c11f8ea
Native commands retain failures through participant cleanup
zlareb1 Nov 17, 2026
a7dda54
Compose current main with native cell attachment
zlareb1 Nov 17, 2026
b253487
WIP: preserve reviewed attach lifecycle corrections
zlareb1 Nov 17, 2026
d182c26
WIP: preserve attach registration and error regressions
zlareb1 Nov 17, 2026
858c90d
WIP: validate serving cell registration and retain wire error codes
zlareb1 Nov 17, 2026
9c02c28
WIP: compose cell attachment with the web listener
zlareb1 Nov 17, 2026
2a379d0
Native command cleanup has a configured deadline
zlareb1 Nov 17, 2026
300c665
Check repeated cancellation against the original clock deadline
zlareb1 Nov 17, 2026
8444e8d
Check that native participant censuses exclude certified history
zlareb1 Nov 17, 2026
30cce29
Compose the merged Postgres batching measurement repair
zlareb1 Nov 17, 2026
2397af5
Describe the fixture owner's recorded ownership digest
zlareb1 Nov 17, 2026
9f84a2b
Exclude certified retirement history from participant reads
zlareb1 Nov 17, 2026
17f8d53
Compare declaration work after parser initialization
zlareb1 Nov 17, 2026
9254790
Prove worker crash recovery within the fixture process namespace
zlareb1 Nov 17, 2026
724299b
Quickstart matches live workers to their registrations
zlareb1 Nov 17, 2026
727e601
Trigger acceptance runs on isolated CI stores
zlareb1 Nov 17, 2026
1e71631
Trigger acceptance waits for TCP and reports owned startup state
zlareb1 Nov 17, 2026
79cd546
Trigger stores use the CI server configuration
zlareb1 Nov 17, 2026
c975843
Trigger ClickHouse runs as its data-directory owner
zlareb1 Nov 17, 2026
bc6bcd6
Trigger setup verifies the owned Keeper configuration
zlareb1 Nov 17, 2026
30d57c3
Worker crash checks report the unproved predicate
zlareb1 Nov 17, 2026
f32c6f1
Attach fixtures isolate authority records and preserve failure causes
zlareb1 Nov 17, 2026
7ad45ce
Attach acceptance verifies two genuine API replicas
zlareb1 Nov 18, 2026
69b6efe
Worker crash checks read captured identities before signalling
zlareb1 Nov 18, 2026
eadf2bf
Standby drill checks ledger visibility after interrupted commit
zlareb1 Nov 18, 2026
bd11af3
Trigger acceptance keeps independent write heads stable
zlareb1 Nov 18, 2026
449769e
Retirement readers filter the native participant UUID
zlareb1 Nov 18, 2026
644f653
The worker census skips exited supervisor children
zlareb1 Nov 18, 2026
88165da
Trigger setup refusals retain bounded child diagnostics
zlareb1 Nov 18, 2026
1a1cee2
Diagnostic read failures preserve the original command refusal
zlareb1 Nov 18, 2026
1fcd50a
The replica fixture matches its migrated vector width
zlareb1 Nov 18, 2026
4e49edf
Keep attach and document source checks in the Postgres workflow
zlareb1 Nov 18, 2026
6521d1b
Wait for supervised replacement enrollment after retirement
zlareb1 Nov 18, 2026
3e82257
Attach deadline tests use an owned cleanup clock
zlareb1 Nov 18, 2026
d5e1411
Resource samples require a complete process forest
zlareb1 Nov 18, 2026
3f69214
Trigger protocol metadata describes its implemented runtime
zlareb1 Nov 18, 2026
c9685ba
Phone citation geometry waits for the selected Ask option
zlareb1 Nov 18, 2026
a400ba3
Native trigger failures retain bounded driver diagnostics
zlareb1 Nov 18, 2026
24a159f
Provider smoke retains bounded reset failure evidence
zlareb1 Nov 18, 2026
09c4f8b
Merge privacy, summary and probe changes into cell attachment
zlareb1 Nov 18, 2026
2460fa2
Trigger acceptance retains bounded Postgres failure evidence
zlareb1 Nov 18, 2026
e9bd5b1
Retirement census distinguishes method calls from local cleanup
zlareb1 Nov 18, 2026
79943b7
Worker parents retire verified stopped children
zlareb1 Nov 18, 2026
ba55790
Worker child retirement follows the application boundary
zlareb1 Nov 18, 2026
23bd673
Verify captured worker subtrees in native recovery checks
zlareb1 Nov 18, 2026
74d59a4
Test child retirement limits and clarify native token minting
zlareb1 Nov 18, 2026
9d6d586
Prove exact exit of single-thread zombie participants
zlareb1 Nov 18, 2026
fa65ac4
Compose cell attachment with the session-protection heartbeat
zlareb1 Nov 18, 2026
da95f2d
Match subtree diagnostic controls to kernel observations
zlareb1 Nov 18, 2026
a1ebaad
Distinguish store guard failures and reap interrupted test children
zlareb1 Nov 18, 2026
3d86ef4
Wait for the published ClickHouse HTTP listener
zlareb1 Nov 18, 2026
00ceb04
Wait for the complete single-thread exit witness
zlareb1 Nov 18, 2026
7112196
Reap the retirement fixture child after interrupted waits
zlareb1 Nov 18, 2026
1d752a7
Collect the attach lock fixture's delayed rollback task
zlareb1 Nov 18, 2026
efcfc40
Isolate retirement gates between integration scenarios
zlareb1 Nov 18, 2026
96bd15e
Trigger acceptance retains bounded staging failure evidence
zlareb1 Nov 18, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
36 changes: 36 additions & 0 deletions .github/workflows/ci.yml
Original file line number Diff line number Diff line change
Expand Up @@ -966,8 +966,16 @@ jobs:
tests/integration/test_pg_clickhouse_live_ch.py
tests/integration/test_cell_tenancy_pg.py
tests/integration/test_router_directory_pg.py
tests/integration/test_pg_online_index.py
tests/integration/test_pg_owned_cleanup.py
tests/integration/test_cell_unset_gate_pg.py
tests/integration/test_cell_prepare.py
tests/integration/test_cell_attach.py
tests/integration/test_cell_attach_two_replicas.py
tests/integration/test_cell_attach_cleanup.py
tests/integration/test_cell_control_cleanup.py
tests/integration/test_cell_control_fence.py
tests/integration/test_directory_control_cleanup.py
tests/integration/test_cell_org_triggers_pg.py
tests/integration/test_source_access_store.py
tests/integration/test_source_document_store.py
Expand All @@ -986,6 +994,34 @@ jobs:
tests/integration/test_marked_rollup_migration_native.py
tests/integration/test_marked_durable_folds_native.py
tests/integration/test_marked_sql_surface_native.py
- name: pytest online-index durability on a private physical standby
timeout-minutes: 8
env:
LOOM_PG_IMAGE: postgres:${{ matrix.postgres }}
LOOM_PG_CONTAINER: loom-scale-index-drill-pg
LOOM_PG_HOST_PORT: "55432"
LOOM_PG_INDEX_DRILL: "1"
LOOM_PG_INDEX_DRILL_DSN: postgres://loom:loomdev@localhost:55432/loom
run: |
set -euo pipefail
for name in loom-scale-index-drill-pg loom-scale-index-drill-pg-standby; do
if docker container inspect "$name" >/dev/null 2>&1; then
echo "drill container already exists: $name" >&2
exit 1
fi
done
if docker network inspect loom-scale-index-drill-pg-net >/dev/null 2>&1; then
echo "drill network already exists" >&2
exit 1
fi
cleanup() {
docker rm -f -v loom-scale-index-drill-pg loom-scale-index-drill-pg-standby || true
docker network rm loom-scale-index-drill-pg-net || true
}
trap cleanup EXIT
bash dev/ci_start_postgres.sh
docker update --memory 1g --memory-swap 1g loom-scale-index-drill-pg loom-scale-index-drill-pg-standby
pytest -q tests/integration/test_pg_online_index_durability.py
# The tenant-isolation gates again, against a second server that enforces auth:
# the Postgres read paths (heads by key and by id, narrowed scopes) see real tokens.
# They run whether or not the memory suites passed (`!cancelled()`).
Expand Down
60 changes: 60 additions & 0 deletions .github/workflows/docker-smoke.yml
Original file line number Diff line number Diff line change
Expand Up @@ -12,6 +12,10 @@ on:
"server/**",
"schemas/**",
"scripts/gates/docker*",
"scripts/gates/cell_trigger_acceptance.py",
"scripts/gates/testsupport/cell_trigger/**",
"bench/cell_trigger_gate.py",
"tests/unit/test_cell_trigger_ci_creator.py",
"frontend/**",
"tests/fixtures/docker_provider_app.py",
"scripts/install-code-toolchains.sh",
Expand All @@ -33,6 +37,9 @@ on:
"tests/unit/test_scip_checkout_fetch_ref.py",
"install.sh",
"pyproject.toml",
"uv.lock",
"dev/clickhouse-ci/log_queries_readonly.xml",
"dev/clickhouse-ci/custom_settings_prefixes.xml",
".github/workflows/docker-smoke.yml",
]
pull_request:
Expand All @@ -45,6 +52,10 @@ on:
"server/**",
"schemas/**",
"scripts/gates/docker*",
"scripts/gates/cell_trigger_acceptance.py",
"scripts/gates/testsupport/cell_trigger/**",
"bench/cell_trigger_gate.py",
"tests/unit/test_cell_trigger_ci_creator.py",
"frontend/**",
"tests/fixtures/docker_provider_app.py",
"scripts/install-code-toolchains.sh",
Expand All @@ -66,6 +77,9 @@ on:
"tests/unit/test_scip_checkout_fetch_ref.py",
"install.sh",
"pyproject.toml",
"uv.lock",
"dev/clickhouse-ci/log_queries_readonly.xml",
"dev/clickhouse-ci/custom_settings_prefixes.xml",
".github/workflows/docker-smoke.yml",
]
# Weekly, so a critical CVE fixed upstream fails here before a release's scan.
Expand Down Expand Up @@ -255,3 +269,49 @@ jobs:
-v "$RUNNER_TEMP/pylib:/pylib:ro" -e PYTHONPATH=/pylib -e PYTHONDONTWRITEBYTECODE=1 \
-e LOOM_ENV_FILE= -e LOOM_TEST_REQUIRE_OWNER_CHECK=1 --entrypoint python loom:sandbox-ci \
-m pytest -q -p no:cacheprovider tests/unit/test_scip_checkout_fetch_ref.py

cell-trigger-acceptance:
name: Cell trigger end-to-end acceptance
if: github.event_name == 'pull_request' || github.event_name == 'push'
needs: clickhouse
runs-on: ubuntu-24.04-arm
timeout-minutes: 150
env:
PYTHONDONTWRITEBYTECODE: "1"
LOOM_ENV_FILE: ""
LOOM_SETTINGS_FILE: ""
steps:
- uses: actions/checkout@3d3c42e5aac5ba805825da76410c181273ba90b1 # v7.0.1
with:
persist-credentials: false
- uses: actions/setup-python@6d4fd22b20465ccc0f7354476588e8df7c9ca0e0 # v7.1.0
id: python
with:
python-version: "3.12"
- uses: astral-sh/setup-uv@68559e99cc807c1eb7e9238fd43a15bba460eec2 # v10.3.3
with:
version: "0.12.19"
enable-cache: true
cache-dependency-glob: uv.lock
- name: Install the locked native dependencies
run: uv sync --locked --python "${{ steps.python.outputs.python-path }}" --extra dev --extra code
- name: Check native tools
run: |
command -v docker
command -v openssl
docker info >/dev/null
- name: Check triggers against real API writes and delivery passes
env:
CLICKHOUSE_IMAGE: ${{ needs.clickhouse.outputs.image }}
PYTHONPYCACHEPREFIX: ${{ runner.temp }}/trigger-bytecode
run: .venv/bin/python -B scripts/gates/cell_trigger_acceptance.py --clickhouse-image "$CLICKHOUSE_IMAGE"
- name: Remove only this attempt's created stores
if: always()
run: .venv/bin/python -B scripts/gates/cell_trigger_acceptance.py --cleanup-only
- name: Retain sanitized trigger acceptance evidence
if: always()
uses: actions/upload-artifact@cf430e030ddbb5b0abf93d22962f4752f3646cd9 # v7.0.2
with:
name: cell-trigger-acceptance
path: ${{ runner.temp }}/cell-trigger-artifacts
retention-days: 7
Loading
Loading