Repository navigation
Redesign the PR summary comment for fast human judgment - #12
Merged
Merged
Conversation
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
OC Claude review: failResult for run 40629688283, attempt 1. Reasons
Prefilter (code, no LLM)Hard blocks: 1.
Dependency deltaNo dependency changes. Findings per passModel output from untrusted input. Check it before you act on it. Verified means only that the quoted text is at that place. It does not mean the claim is true. review: failed, authentication failedNo verified findings. security: failed, authentication failedNo verified findings. supply-chain: failed, authentication failedNo verified findings. Token usage
Workflow run. The result that counts is the required workflow in the merge box. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What changes
Why
The old comment was hard to judge quickly. The owner chose this design from two candidates.
Safety
Markers, override line and size limits are unchanged. Model text is escaped, so it cannot forge headings, callouts or the result line (probed in review).
Tests
cd review && uv run pytest tests/unit -q-> 2631 passed, 2 deselectedcd review && uv run pytest tests/unit -m release -q-> 2 passed, 2631 deselectedRendered examples
Example: PR 39 comment
🔴 FAIL: OC Claude review
src/app.py:10src/app.py:10Run 1000, attempt 1 for head
aaaaaaainto main. The required workflow in the merge box is the result that counts. This bot never approves a PR.🔑 Waiver: how a maintainer clears this
This PR fails for waivable reasons only. A person with write or admin access, who is not the PR author, posts this exact line as a new comment and replaces
<reason>with the reason. Then they re-run the newest run of the required workflow through the GitHub REST API (POST .../actions/runs/{run_id}/rerun). Do not edit the comment afterwards. Do not close and reopen the PR to apply the waiver.A waiver covers the code at this exact head and merge base. Any new push needs a new waiver.
📋 Full review record: reasons, checks, signals, finding details, model summaries, token usage
Reviewed snapshot
aaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaaccccccccccccccccccccccccccccccccccccccccReasons the gate failed
Checks (code, no model)
Signals (context only, never block)
Dependency changes
None.
Finding details
Blocking is decided by code from category and severity, never by the model. A finding in a blocking category blocks only at high or critical severity.
Each row above merges findings of several passes at the same file, line and gate effect.
Model summaries
Token usage
Known Minor, not fixed
Hard block data shows in three tables. A PR with many hard blocks reaches the overflow notice sooner (fails closed).
🤖 Generated with Claude Code