ci: run the suite 10-way, not 6-way (measured 60.4 s -> 38.3 s per leg) #1706
No reviewers
Labels
No milestone
No project
No assignees
1 participant
Notifications
Due date
No due date set.
Dependencies
No dependencies set.
Reference
jaylouisw/packetforge!1706
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "ci/1116-1820"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
The suite is the whole wall clock of every
Test (Node *)leg, and the number of processes it is allowed to overlap was chosen for 281 suites: 6. There are 285 now, and the same host has 40 cores.Baseline (measured, not assumed)
Same commit
eb172083, node:20-bookworm in the runner's own image on odin,node scripts/run-tests.js:Every one of those runs: 285 suites, 10234 assertions, 0 failed. The three-leg row is the one that matters - it is the shape the matrix actually takes on a three-slot runner - and it is 37% off the leg.
Caveat kept honest: the only failure seen in the benchmark was
canonical-urls' "the tree is clean again once the probe is removed", which fails identically at 6 and at 10 and only in the benchmark copies (they arecp -aof a shallow clone, not a runner checkout). Real legs on this commit are green.After
PF_TEST_CONCURRENCY: 6->10in the one step that runs the suite. 10 rather than 12: 12 buys 1.3 s on an idle host and allocates a fifth more processes under the contention where the cost is actually paid. The harness caps at 16 and nothing else in the workflow changes.Coverage unchanged: all three Node legs still run all 285 suites on 18, 20 and 22, plus the syntax check in parallel, the example labs and the missing-devices scan. Nothing is skipped, nothing is filtered, no timeout is touched.
Attribution: a further +1-2 s per leg goes to the duplicated
check-control-bytes.js(it is both a step and the second command ofnpm test) - left alone because it also runs insidenpm teston purpose, as a gate that does not depend on the step graph.ead50d61f704b4558e77