[dinakarjs]

Connect the real Python and TypeScript telemetry SDKs through pinned official Collector 0.163.2 to a synthetic SQLite-backed loopback receiver. Local evidence, observed requests and backend commits are recorded separately.

Twenty real-pipeline cases now pass: twelve baseline fault cases plus eight queue/fidelity cases (healthy queue, blocked-consumer saturation, collector kill between commit and ACK followed by a fresh event, and reversed source-timestamp input, for both languages). The stress receiver compares complete normalized bodies, event names and exact nanosecond timestamps. Six observer unit tests catch corrupted projections and vacuous delivery assertions.

Validation: Ubuntu run https://github.com/agentrust-io/agentrust-telemetry/actions/runs/40204045774 at code head 02d5c64 passed all twenty cases and six observer tests. Both SDKs produced evidence/attempts/commits of 8/8/8 healthy, 8/1/1 saturation, 2/2/2 in-flight restart and 3/3/3 reversed timestamp input. Collector overflow is also independently required in its log. Full configs/inputs/logs/SQLite/summaries are retained as workflow artifacts. Two earlier stress attempts exposed harness scheduling/capacity assumptions; those were corrected before the successful run. The subsequent documentation confirmation run 40204226853 delivered all reversed-input TypeScript events intact but exposed an unsupported arrival-order assertion. This head fixes that observer contract: it verifies descending source timestamps, local input event-ID order, all backend commits and full per-event fidelity, while recording and permitting concurrent HTTP reordering. Six observer controls and all twenty delivery cases now pass on final code head 3cf135a in Ubuntu run https://github.com/agentrust-io/agentrust-telemetry/actions/runs/40204492721 . CI, CodeQL and workflow lint also pass on this exact head. The local and published source trees are identical.

Python compilation, JavaScript syntax and TypeScript build pass locally. Local Collector delivery is blocked before receiver startup by process-metrics registration; actual delivery evidence above comes from supported Ubuntu CI.

Limits: synthetic loopback only. New cases use an in-memory queue; restart does not establish persistent queue replay. Saturation deliberately observes loss; SQLite uniqueness is backend deduplication, not an exactly-once Collector guarantee. No production endpoint, runtime SDK behavior, release permission or separately provisioned cloud resource changes. Independent maintainer review remains pending.

Signed-off-by: Srinivasa Dinakar Jainti dinakarjs@gmail.com. Prepared with OpenAI Codex. See experiments/collector/README.md.

Self-review: hosted checks and acceptance boundaries — 31 October 2026

Reviewed current head 3cf135ad1698d9157e99ff1396e8c1665bb0b4a3 against the workflow definitions, CONTRIBUTING.md, GOVERNANCE.md, CODEOWNERS and the active default-branch ruleset. This is an author self-review of checker coverage and reported evidence, not an independent approval or a fresh execution/source audit.

Check	Observation
Required Python matrix	test (3.10), test (3.11), test (3.12) and test (3.13) all succeed on this head. Workflow covers version/schema/OTel compatibility, conformance, unit tests and compilation; 3.12 also builds and smoke-tests wheel/sdist.
Required TypeScript check	typescript succeeds; workflow builds/tests the SDK and exercises the packed npm artifact.
Required analysis check	analyze succeeds. CodeQL workflow also completes successfully.
Collector experiment	collector succeeds in run 40204492721. The workflow runs baseline delivery cases, observer controls and stress cases, then uploads both evidence directories even on failure.
Workflow validity	actionlint succeeds.
Applicability	Dependabot auto-merge is skipped for this contribution. Collector and actionlint pass but are not listed among the six mandatory status contexts in the inspected ruleset. The experiment README explicitly says it is not a release gate yet.

Reviewer acceptance should assess the twelve baseline and eight stress cases for both SDKs: healthy delivery, first-response 503, lost acknowledgement, partial rejection, duplicates, idle restart, healthy queue, blocked-consumer saturation, kill between commit and acknowledgement, and reversed source timestamps. Check that local evidence, observed attempts and backend commits remain distinct; saturation requires explicit Collector overflow and positive commits plus observed loss; full normalized bodies, event names and nanosecond timestamps are checked; and all six observer controls reject the documented corrupt or vacuous results. The corrected order contract requires the local input sequence and descending source timestamps while permitting concurrent HTTP arrival reordering.

The successful final-head run is recorded in this PR description; the README's closing “final-head confirmation is required” sentence is historical wording that this run satisfies, not a fresh outstanding experiment failure. No archived artifact was re-downloaded or re-audited in this follow-up.

Remaining acceptance: the inspected ruleset requires one approving review, code-owner review, approval of the latest reviewable push, resolved review threads and strict up-to-date required checks; it dismisses stale reviews on push and enables additional approval for unattributed changes. No submitted independent review is currently returned, and Imran's review request is pending. Classic branch-protection settings could not be inspected with this connection, so this is not a complete certification of every administrative merge rule.

Claims remain limited to the documented synthetic loopback pipeline. In-memory restart is not persistent-queue replay, backend uniqueness is not an exactly-once Collector guarantee, and no production-delivery assurance follows from these checks. Local Collector startup remains blocked before delivery; supported-host evidence comes from Ubuntu CI. No new run or additional coverage is claimed by this self-review.

Prepared with OpenAI Codex.

Required-checks checklist and proposed policy decision — 31 October 2026

Applies to head 3cf135ad1698d9157e99ff1396e8c1665bb0b4a3. Checked items below record the inspected head's existing evidence; proposed policy items remain pending maintainer decision.

Existing merge requirements

• test (3.10) succeeds.
• test (3.11) succeeds.
• test (3.12) succeeds, including wheel/sdist build and smoke checks.
• test (3.13) succeeds.
• typescript succeeds.
• analyze succeeds.
• Independent maintainer/code-owner review and approval covering the latest reviewable push.
• Maintainer confirms review threads are resolved and strict branch/ruleset requirements are satisfied at merge time.

Additional evidence for this PR

• collector succeeds for the documented twenty delivery cases and six observer controls.
• actionlint succeeds.
• Current-head CI, Collector experiment, Workflow lint and CodeQL workflows complete successfully.
• Experiment limits and evidence-source distinctions are recorded in the self-review above.

Recommendation for maintainers to decide

• Make actionlint mandatory: run it on every PR before adding its status context to the required-checks policy. It is a small deterministic check that catches invalid workflows/expressions and shell issues ordinary YAML parsing misses.
• Require Collector validation for relevant changes after accepting this experiment: use an always-reported result that requires the real collector job to succeed when experiment code, SDK/emitter/exporter behavior, relevant schemas/dependencies, Collector configuration/version or the workflow itself changes. Changes outside the accepted scope may report an explicit not-applicable success.
• Approve the trigger/scope and implementation before enforcing Collector policy: today's workflow-level path filter covers only experiments/collector/** and its workflow; it neither reports on every PR nor covers all SDK/dependency changes. Do not add this filtered context directly as an unconditional required check.
• Ensure any applicability/result check fails on failed, cancelled, missing or unexpectedly skipped required execution; unknown applicability must not silently pass. Verify both an unrelated-change PR and a relevant-change PR, plus a failing Collector control.
• Name the Collector maintenance owner and agree reliability/runtime expectations and evidence retention before rollout.

Recommended order: accept the bounded experiment on its evidence and normal review, then roll out workflow scheduling and required-context policy in a separately reviewed change. Collector validation adds synthetic integration coverage; it does not become production-delivery or persistent-recovery certification. This policy recommendation is not approval to change repository settings.

[github-actions]

🟡 Contributor Check: MEDIUM

Check	Result
Profile	MEDIUM
Credential	LOW
Overall	MEDIUM

Automated check by AgenTrust Contributor Check.

[dinakarjs]

@imran-siddique requesting your independent review and maintainer disposition at current head 3cf135a. Your formal review request is already pending; no submitted review is currently returned.

I have just rechecked the head: Collector fault experiment, CI, Workflow lint and CodeQL all succeeded. The experiment uses the real Python/TypeScript SDKs with pinned Collector 0.163.2 and a synthetic SQLite-backed loopback receiver. The published run records all 20 delivery cases and six observer controls passing; the description links the retained evidence and documents the corrected arrival-order observer contract.

Please review this bounded experiment and confirm whether it can proceed through normal merge gates, or identify remaining changes. In-memory queue restart does not establish persistent replay; saturation includes observed loss and backend uniqueness is deduplication, not an exactly-once guarantee. Prior experimental evidence is cited, not a fresh run. Prepared with OpenAI Codex.

[dinakarjs]

@imran-siddique requesting a maintainer decision on whether actionlint and Collector validation should become mandatory merge checks. I updated this PR's required-checks checklist, distinguishing the six existing mandatory contexts (all passing at 3cf135a), the passing collector/actionlint evidence, and the outstanding independent approval.

Our recommendation:

1. Make actionlint mandatory after changing its scheduling to run on every PR. It is low-cost and detects workflow/expression/shell failures beyond YAML validity.
2. After accepting this bounded experiment, require Collector validation for relevant experiment, SDK/emitter/exporter, schema/dependency, Collector config/version and workflow changes through an always-reported applicability/result check. Unrelated changes can explicitly report not applicable; relevant execution must actually pass. Failed/cancelled/missing/unexpectedly skipped execution or unknown applicability must not pass.
3. Do not directly require the current filtered collector/actionlint contexts: both workflows use pull_request.paths, so unaffected PRs can wait indefinitely for missing required checks. The current Collector trigger also misses relevant SDK/dependency paths.
4. Agree the applicability scope, maintenance owner, reliability/runtime expectations and evidence retention, then implement and verify scheduling plus repository enforcement in a separately reviewed change. Test unrelated and relevant PRs plus a failing Collector control before enabling the rule.

Please approve, adjust or decline this recommendation and identify the owner/rollout conditions. Repository settings and workflow source have not been changed by this checklist update. This proposal does not strengthen the experiment's synthetic-loopback assurance claims. Prepared with OpenAI Codex.