chore(agents): add test-audit skill for contributor test-quality gating - #3697
Open
politerealism wants to merge 1 commit into
Open
politerealism wants to merge 1 commit into
politerealism wants to merge 1 commit into
Conversation
OpenShell had no internal skill for auditing test quality across its five distinct test surfaces (Rust unit tests, e2e/rust, the conformance suite, the tmachine/Ansible harness, and the Python/TypeScript/Go SDKs). Modeled on openclaw's test-audit skill, adapted to this repo's actual tooling (mise tasks, cargo nextest, uv, driver feature gates) instead of Vitest, with two OpenShell-specific additions grounded in lessons from NVIDIA#3663/NVIDIA#3690: a section on deriving expected values from an independent source rather than tracing the implementation itself, and a section on testing the handoff between components (process, privilege, and declaration-to-enforcement boundaries) rather than only what's inside each one. Wired into CONTRIBUTING.md's contributor skills table per sync-agent-infra's maintenance map; no other cross-references needed updating. Signed-off-by: politerealism <burdcat17@gmail.com>
politerealism
requested review from
a team,
derekwaynecarr,
mrunalp and
sjenning
as code owners
September 25, 2026 01:44
This branch has not been deployed
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds
.agents/skills/test-audit, an internal contributor skill for gating new tests and auditing existing ones for junk patterns, mock-only coverage of real dependencies, and low-value duplication across OpenShell's test surfaces (Rust unit tests, e2e/rust, the conformance suite, the tmachine/Ansible harness, and the Python/TypeScript/Go SDKs). Modeled on openclaw's test-audit skill, adapted to this repo's actual tooling.Related Issue
N/A — internal contributor tooling, no product behavior change. (Precedent: PR #293, which introduced
.agents/skills/andsync-agent-infraitself, used the same "N/A — internal initiative" framing.)Changes
.agents/skills/test-audit/SKILL.md(new): three modes (authoring gate, audit, campaign) built around one value bar — does a test protect an independent contract, not just mirror the implementation. Includes two sections grounded in lessons from test(podman): close CI coverage gaps in Podman compute driver testing #3663/test(podman): close rootful userns, resource-limit, and daemon-failure CI gaps #3690:podman_resource_limits.rscgroup-value cross-check as a worked example of deriving expected values independently instead of tracing them from the code under test.CONTRIBUTING.md: added the skill to the "Agent Skills for Contributors" table under the Contributing category.Testing
mise run pre-commitpassessync-agent-infra's consistency checklist: skill name matches directory,metadata.internal: trueset, name globally unique, no other file (AGENTS.md, README.md, issue templates, workflow-chain references) needed updating.Checklist
🤖 Generated with Claude Code