Repository navigation
ci: parallelize the fast integration tier and refresh the shard durations - #570
Merged
Merged
Conversation
Two slow files, ca_trust_test.py (270s) and playwright_mcp_local_test.py (89s), were missing from the table, so each weighed the median and landed on a shard at random. The installer tier's times come from run 42675261871, since main skipped that tier. Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
It ran serially, at 585s for 181 tests. make int-test-fast already runs it with -n auto --dist loadscope. Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
andrewpark-scaleai
enabled auto-merge (squash)
November 9, 2026 20:50
earakely-scale
approved these changes
Nov 9, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What and why
The goal is shorter Local backends runs. That workflow takes 16 to 18 minutes, while every other workflow takes under 5. This PR makes two small changes.
integration-localran its 181 tests serially, which took 585s in run 42675210519. It now uses-n auto --dist loadscope, the same flags asmake int-test-fast. loadscope keeps a module's tests on one worker, so module fixtures still run once. The serial setting came with the initial import, and no commit gives a reason for it.tst/integration/slow_durations.json. They wereca_trust_test.py(270s on main) andplaywright_mcp_local_test.py(89s). The balancer gave each the median weight, so they landed on shards at random. I rebuilt the table with.github/scripts/slow_test_durations.pyfrom main's run 42667684447. I added the installer reports from run 42675261871, because main skipped that tier and a rewrite without them would drop its 59 entries.What this does not fix
The refresh does not reliably shorten the slow tier. I assigned the shards with each table and timed the result against run 42675210519, which the new table was not built from. The slowest shard came out at 875s with the old table and 908s with the new one. Between that run and main, computer tests changed by 60 to 114s each. Four of that run's slow shards missed the computer-image cache, because the repo's Actions cache is at 10.7GB, which is over the 10GB limit, and its 12 per-shard entries evict each other. The fix for that is a shared image cache, which is a separate change.
On the same check, the unit tier's heavier shard drops from 1395s to 1293s of test time, with the two shards within 14s of each other.
How it was tested
tst/util/shards.pyselect()directly with the old and new tables over the junit times from runs 42667684447 and 42675210519.

Confidence Score: 5/5
The PR appears safe to merge; no actionable issues were found.Summary
The PR runs fast integration tests with
-n auto --dist loadscopeand refreshes the times used to balance CI shards.andrewpark-scaleai explicitly acknowledges that the refresh does not reliably shorten the slow tier and defers the shared image-cache fix to a separate change.
Reviews (1) · Last reviewed commit: "ci: run the fast integration tier on eve..." · Reviewed by Greptile