Skip to content

flow: measure the extra identity looks and the hover look - #1340

Merged
abrichr merged 11 commits into
mainfrom
claude/pixel-identity-measure
Oct 20, 2026
Merged

abrichr merged 11 commits into
mainfrom
claude/pixel-identity-measure

Conversation

@abrichr

@abrichr abrichr commented Oct 19, 2026

Copy link
Copy Markdown
Member

Stacked on #1333 and #1334 (their commits show here until they merge). This PR's own changes are the last two commits: numbers, docs and the artifact inventory.

Results

Dense record list (benchmark/identity_looks/IDENTITY_LOOKS.md): the real replayer against a live browser render, 288 armed clicks on the correct row and 288 on the adjacent sibling. Before = origin/main 426d08f2d, after = 283336358.

False stops, before False stops, after Wrong-record accepts
No list, no copy 232 / 288 232 / 288 0 / 0
Known-ID list 122 / 288 122 / 288 0 / 0
Copy look, ID as a run parameter n/a 24 / 288 0
List and copy, ID as a run parameter n/a 24 / 288 0
Copy look, recorded record n/a 232 / 288 0

22 of the 24 remaining stops are IDs the recording itself read with a look-alike glyph, so the band isn't linked to the run parameter. In a workflow that always opens the recorded record, the copy can't confirm anything.

Hover kiosk (benchmark/hover_identity/): two identical icons that differ only by tooltip, swapped between recording and replay. Look-alike icon clicked: 2 of 3 runs before, 0 of 3 after. Click steps with identity evidence: 1 → 2 of 5.

Display-scaling sweep re-run: unchanged (17/24 healthy, 24/24 wrong-record runs stopped, 0 wrong writes). The MRN A1001 kiosk still stops off the recorded render: it always opens the recorded record and has no selectable text.

Docs

IDENTITY_EVIDENCE.md, LIMITS.md, the flow README sentences on 1/l and 0/O and on identity coverage, docs/CAPABILITIES.md, root CAPABILITIES.md (two rows; no new commands), the pixel_scale README. public-artifacts.json regenerated from a clean checkout (six new evidence files, nothing else).

Limits

Synthetic data, one OCR engine, browser pages and in-process kiosks; not a live RDP or Citrix session. On RDP/Citrix the copy look needs clipboard redirection, which many deployments turn off. No timings are claimed; runs were made under heavy machine load.

🤖 Generated with Claude Code

abrichr and others added 4 commits October 19, 2026 10:07
- The copy drag now runs to the edges of the identifier's text box; it
  stopped inside the last glyph and copied one character short.
- A split identifier (103 045 against 103045) is matched as one string,
  against the read and the known-ID list.
- The check just before the click reuses the step-entry verdict when the
  identifier shows the same pixels, instead of re-reading the selected text.
- A run-parameter mismatch that is only a look-alike misread (C0X1234 read
  as COX1234) gets the same looks. The mismatch stands unless the list or
  an exact copy of the run value settles the record.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
- Dense record list, real replayer, live browser render (288 correct-row
  and 288 sibling clicks): with a copy of the ID and the ID as a run
  parameter, false stops 232 -> 24; with the known-ID list 122 -> 122;
  wrong-record accepts 0 in every configuration.
- Hover kiosk with two identical icons swapped: look-alike icon clicked in
  2 of 3 runs before, 0 of 3 after; click steps with identity evidence
  1 -> 2 of 5.
- Display-scaling sweep re-run: unchanged (17/24 healthy, 24/24
  wrong-record runs stopped, 0 wrong writes).

Updates IDENTITY_EVIDENCE.md, LIMITS.md, the flow README, both
CAPABILITIES pages and the pixel_scale README.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Regenerated from a clean checkout of f73e8e8.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
abrichr and others added 4 commits October 19, 2026 10:38
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…-measure

# Conflicts:
#	packages/flow/public-artifacts.json
Regenerated from a clean checkout of d66be00.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@abrichr

abrichr commented Oct 19, 2026

Copy link
Copy Markdown
Member Author

Included in batch #1385, which runs CI once for several reviewed PRs. This PR is marked merged when #1385 merges. Please don't push here unless asked; a new commit leaves it out of the batch.

abrichr added a commit that referenced this pull request Oct 20, 2026
@abrichr
abrichr merged commit 81ba390 into main Oct 20, 2026
30 of 40 checks passed
@abrichr
abrichr deleted the claude/pixel-identity-measure branch October 20, 2026 02:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant