Skip to content

perf(CI-05): bound concurrent browser conformance workers - #751

Merged
ellainng merged 3 commits into
mainfrom
perf/CI-05-browser-workers
Nov 2, 2026
Merged

ellainng merged 3 commits into
mainfrom
perf/CI-05-browser-workers

Conversation

@ellainng

@ellainng ellainng commented Nov 2, 2026 •

Copy link
Copy Markdown
Member

Browser conformance previously awaited every fresh worker sequentially. A bounded pool now overlaps two independent workers while preserving input-order results, the existing 10-second per-case deadline, and cleanup on success, worker errors, serialization errors, construction/post failures and timeouts. Set POCKET_PYTHON_BROWSER_WORKERS=1–8 to compare another bound. No profile, driver or case is removed.

Local CPython 3.14.7/macOS arm64 Chromium benchmark, full 1,741-case exceptions corpus: 1 worker 101.942s; 2 workers 56.267s; 4 workers 33.772s; 8 workers 28.077s. All ordered results, resource counters and teardown observations matched exactly. Two is the conservative default pending Linux runner observations. The committed benchmark command supports repeated comparisons and a JSON report.

Validation: three focused worker-pool tests, 13 Python runner/reference tests, unchanged engine lock and real-browser differential comparison at all four pool sizes.

#750 is merged. Closes #747.

Batch verification: all 16 regression jobs pass in run 41424015512 on descendant #752, which includes this complete worker implementation. The parent reconciliation changes history and resolves only an overlapping documentation insertion. The earlier run completed all 99 interpreter-shard-3 checks and every upload/cleanup step before the overall job deadline marked it cancelled; complete passing descendant coverage supersedes that job status.

@ellainng
ellainng changed the base branch from perf/CI-04-reference-cache to main November 2, 2026 09:54
@ellainng
ellainng merged commit 281ef6e into main Nov 2, 2026
@ellainng
ellainng deleted the perf/CI-05-browser-workers branch November 2, 2026 10:07
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

CI-05: Bound concurrent browser conformance workers

1 participant