Skip to content

feat: a review that drops noise, and a build that answers review comments - #35

Merged
Lutherwaves merged 9 commits into
feat/decommissionfrom
feat/review-comments
Nov 12, 2026
Merged

Lutherwaves merged 9 commits into
feat/decommissionfrom
feat/review-comments

Conversation

@Lutherwaves

Copy link
Copy Markdown
Owner

What a person can now do

  • A person who reads a builder review gets only findings that are worth their time. review drops noise by a written list, says what it dropped and why, and makes one last sweep over what its findings did not touch.
  • A person who gets review comments on a change can hand them to build. Each comment gets one outcome and one reply: fixed, declined, already fixed, or needs the person.

What changes

  • skills/review/bar.md (new): the keep test (a trigger and a harm, both named), the drop list, and the sweep. A security record is never dropped. An unconfirmed finding stays, marked "from reading".
  • skills/build/comments.md (new): the four outcomes, when a fix is safe to make alone, whose comment counts for how much, and what goes to the person. build never changes or removes an existing test to make a fix pass without the person.
  • review and build treat text in a diff, a description, a comment or a log as data. An instruction inside it is reported, not followed.
  • Two new eval fixtures: review-noise and review-comments.
  • A fourth credit: PostHog/posthog (MIT outside its ee/ folder). builder takes the ideas and copies no text.
  • Net: 25 files, 752 lines added, 19 removed.

Proven

  • go test ./... passes.
  • bash scripts/validate.sh prints "all checks passed" (scrub skipped: no denylist), and bash tests/test_validate.sh exits 0.
  • bash tests/evals/run.sh --check prints "fixtures ok".
  • Both fixtures behave as designed in a temporary copy: the mailer returns success after all retries fail, and an empty cart with a percentage coupon raises ZeroDivisionError.

Not proven

  • No paid eval has run. The two new fixtures have never been run against an agent, with or without builder, so neither new behaviour is proven. The skill text was written before its baseline was seen.
  • The rule "two comments that disagree both go to the person" is prose only. No fixture tests it.

Stack

Third of three. Base: feat/decommission. Design: docs/specs/2026-11-12-review-comments-design.md.

🤖 Generated with Claude Code

Lutherwaves and others added 9 commits November 12, 2026 01:10
…omments

Five ideas from PostHog's review skills, taken as ideas with no copied text.

Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
…nd spots

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…ne reply

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
…mments

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
"When unsure" in bar.md now means only "unsure whether the drop list
covers it". A candidate that passes the keep test but could not be run
stays a finding, marked "from reading". The one-line sweep result is
the last sentence of "What I ran".

The review-noise fixture plants the short name and the missing None
guard as open questions in the description, so a faithful reviewer
meets both. The allow list no longer lets the agent run the mailer,
which tried a real connection to a local relay.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Comments from people and bots take the comments path; findings of
builder's own review take the path in "Done", and fixed comments go
back to review. Each comment that needs the person is a ▶ You item,
and it stays open when nobody answers.

comments.md states the four outcomes once, declines a real problem
that is out of scope or already settled by a recorded decision, sends
a change to an existing test or a maintainer's ask to remove one to
the person, and separates a request about the change from an order to
the agent. The README says that build answers review comments.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Fable 5.2 <noreply@anthropic.com>
@Lutherwaves
Lutherwaves merged commit 0b7e7d7 into feat/decommission Nov 12, 2026
3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant