Skip to content

scoreboard: the landing demo's four OpenEMR referrals, each report under an offline Seal - #1391

Closed
abrichr wants to merge 2 commits into
mainfrom
claude/referral-demo-offline-seals
Closed

abrichr wants to merge 2 commits into
mainfrom
claude/referral-demo-offline-seals

Conversation

@abrichr

@abrichr abrichr commented Oct 20, 2026

Copy link
Copy Markdown
Member

The landing page's four OpenEMR referrals, run by the compiled program with the engine's REST record check on. Each run report is signed with an offline Seal, signed by this machine's key, so /seals and the demo can show real ones. Synthetic data only, no model calls.

Referral Outcome in the report Read-back
1 Nadia Brennan COMPLETED_UNVERIFIED, every record check confirmed 1 chart, 12 of 12 fields
2 Marcus Feld COMPLETED_UNVERIFIED, every record check confirmed 1 chart, 12 of 12 fields
3 Ines Carvalho COMPLETED_UNVERIFIED, every record check confirmed 1 chart, 12 of 12 fields
4 Rosa Delgado (possible duplicate) HALTED at the duplicate check before saving; transaction RECONCILIATION_REQUIRED no chart
  • Why not VERIFIED: the runs use no named execution profile. The standard profile's gate refuses this bundle today: 34 certification violations, 2 unarmed consequential steps, and 1 screen-only check. So the reports say COMPLETED_UNVERIFIED, and each Seal copies that.
  • Referral 4: no chart was written, but unreviewed-risk steps keep the engine from proving that, so its transaction outcome is RECONCILIATION_REQUIRED (Self-repair can't take openIMIS's relabelled Save: RECONCILIATION_REQUIRED from unreviewed-risk steps, and the halt is on the scroll #1331). It has a report and its offline Seal, and no receipt; local receipts exist only for VERIFIED runs.
  • The Seals: openadapt.local-seal/v1, key seal-ed25519-accd03a9246d29bb, with the public key in seal-key.json. These are not Cloud Seals, which wait for an explicit OK.
  • To verify: run openadapt-flow local-seal verify <run>/engine --keys seal-key.json. All four print valid offline Seal over report.json. An edited report prints not valid: subject_mismatch.

The files are in packages/flow/benchmark/scoreboard/raw/openemr_referral/seals/2026-10-19/, with a README. The script is scoreboard/seals_referral_demo.py, which uses the #1269 harness (engine 93c32e9, API steps off). The inventory was regenerated from a clean checkout.

🤖 Generated with Claude Code

abrichr and others added 2 commits October 19, 2026 21:13
…ecord check, each report under an offline Seal

Referrals 1-3 (Nadia Brennan, Marcus Feld, Ines Carvalho) completed with
every record check confirmed and 12 of 12 fields read back; referral 4
(Rosa Delgado, the possible duplicate) stopped at the duplicate check with
no chart written. No named execution profile, so COMPLETED_UNVERIFIED, not
VERIFIED. Each report.json carries an offline Seal (openadapt.local-seal/v1,
this machine's key, public key committed); verify with
openadapt-flow local-seal verify <run> --keys seal-key.json. Synthetic data
only, no model calls.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@abrichr
abrichr marked this pull request as draft October 20, 2026 01:19
@abrichr

abrichr commented Oct 20, 2026

Copy link
Copy Markdown
Member Author

Superseded, keep as a draft: these used referrals r1-r3 and r6 under no named profile. The site's demo is r3-r6 (study block 2, items 201-204), and the coordinator chose to qualify the bundle so the saved referrals end VERIFIED under the standard profile. A new PR follows with those runs.

@abrichr

abrichr commented Oct 20, 2026

Copy link
Copy Markdown
Member Author

Superseded by #1409: the certified-bundle runs r3–r6 (r3–r5 VERIFIED, r6 stopped before saving, standard profile), with redacted reports re-sealed. The earlier runs in this PR were unverified and aren't used by the site.

🤖 Generated with Claude Code

@abrichr abrichr closed this Oct 20, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant