CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

docs-corpus-audit

Use this skill to run a holistic regrounding pass on the entire microsoft/apm documentation corpus against current source code, page-by-page, and emit surgical fixes for stale claims. Activate when the maintainer wants a WHOLE-CORPUS audit (not per-PR review) -- typical triggers include "audit the docs", "reground the corpus", "check every page against code", "pre-release docs sweep", "the docs have drifted everywhere", or "we just reshaped the TOC, find dead links". Wave-batched and S7-verified; scales to the full ~112-page corpus in ~10 minutes wall-time. This is a SIBLING to docs-sync, not a replacement: docs-sync is per-PR (triggered by a diff); this skill is per-corpus (triggered by a maintainer ask). They share agent personas, schemas, and the docs index, but their triggers MUST NOT collide. Does NOT auto-merge, does NOT push without maintainer review, and does NOT replace per-PR drift detection.

70

Quality

88%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

77%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A strong, well-architected body: a clearly sequenced multi-wave workflow with genuine validation and feedback loops, deterministic verification commands, and a real single-writer safety model for git. The two material weaknesses are the dangling evals/ references (an entire referenced directory is absent from the bundle) and codename jargon inherited from the extraction session that costs tokens without informing execution.

Suggestions

Add the evals/ directory (content-evals.json, trigger-evals.json, README.md) to the bundle, or remove the Evals section — three of the referenced paths currently dangle, which breaks progressive-disclosure navigation.

Strip or expand the session codenames ("A1 PANEL", "S7", "A8", "A9", "R3 EXTRACT") into plain language — they are opaque outside the original session and cost tokens without aiding execution.

Move the Provenance section and the dated session stats (PR #1511, 2026-05-27) out of SKILL.md or into a clearly marked background note; they are time-sensitive and not needed at runtime. Optionally merge the duplicate sibling-boundary explanations (table + trigger list + Boundary section) into one.

DimensionReasoningScore

Conciseness

The body is dense and almost every line is actionable — no explaining of concepts Claude already knows — but it carries opaque internal-codename padding ("A1 PANEL + WAVE EXECUTION + S7 DETERMINISTIC TOOL BRIDGE + A8 ALIGNMENT LOOP + A9 SUPERVISED EXECUTION", "that's R3 EXTRACT in reverse") that is meaningless without external session context, plus a Provenance section with dated session history ("PR #1511, 2026-05-27") outside any old-patterns section. Not 5 because these passages and the duplicated sibling-boundary explanation (table plus trigger list plus body text) could be trimmed; not 3 because the padding is minor relative to the overall signal density.

4 / 5

Actionability

Mostly executable: concrete verification commands ("`uv run apm <verb> --help` for CLI, `grep -n src/apm_cli/` for symbols, `python -c \"import ...\"`"), a real dispatch template (assets/subagent-prompt-template.md) with explicit substitution variables ("substitutes scope + working dir + branch"), and a real deterministic script (scripts/scan-cross-corpus-drift.sh) with usage notes. Falls short of 5 because the dispatch step itself is abstract ("dispatches one task per scope using the prompt template" with no example invocation) and PROBE checks are described but not given as commands.

4 / 5

Workflow Clarity

The 8-step process (PROBE → RISK-TRIAGE → WAVE-PLANNER → WAVE EXECUTION → POST-PASS → ALIGNMENT LOOP → COMMIT+PUSH → PR+SUMMARY) has explicit validation checkpoints and feedback loops throughout: schema validation of every subagent return ("Validate every return against the schema; reject malformed JSON"), a bounded alignment loop ("Any residue triggers a targeted re-dispatch (max 2 redrafts) or is escalated to maintainer"), a pre-flight gate ("Verify on a working branch (not main)", ask-maintainer guard if the backfill target is missing), and a single-writer interlock for git. This batch operation fully satisfies the validation requirement.

5 / 5

Progressive Disclosure

The three core bundle files referenced (assets/subagent-prompt-template.md, assets/panelist-return-schema.json, scripts/scan-cross-corpus-drift.sh) all exist and are well-signaled one level deep, but the "Evals" section points to evals/content-evals.json, evals/trigger-evals.json, and evals/README.md — none of which exist in the bundle — and there is no references/ directory, so three referenced paths dangle. Structure is otherwise good, but broken navigation plus inline content that could live in reference files (cost model, provenance, the full sibling-contract table) keeps this below 4.

3 / 5

Total

16

/

20

Passed

Description

95%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An exemplary description: concrete capability statement, an explicit activate-when clause with six verbatim user trigger phrases, and a sharply drawn boundary against the sibling docs-sync skill that all but eliminates dispatch collision risk. The only weaknesses are unexplained internal jargon ("S7-verified", "Wave-batched") and drift-class detail deferred entirely to the body.

DimensionReasoningScore

Specificity

Lists several concrete actions — "run a holistic regrounding pass on the entire microsoft/apm documentation corpus against current source code, page-by-page, and emit surgical fixes for stale claims" — with a stated scale ("~112-page corpus in ~10 minutes"). Falls short of 5 because the specific drift classes it catches (stale flags, dead nav links, expired deprecation targets) appear only in the body, and "Wave-batched and S7-verified" is unexplained jargon.

4 / 5

Completeness

Explicitly answers both questions: what ("regrounding pass on the entire... corpus... emit surgical fixes for stale claims") and when ("Activate when the maintainer wants a WHOLE-CORPUS audit") with concrete trigger phrases, plus when-not-to guidance ("Does NOT auto-merge, does NOT push without maintainer review, and does NOT replace per-PR drift detection").

5 / 5

Trigger Term Quality

Six natural maintainer phrases are quoted verbatim: "audit the docs", "reground the corpus", "check every page against code", "pre-release docs sweep", "the docs have drifted everywhere", "we just reshaped the TOC, find dead links" — comprehensive coverage of realistic phrasings including the negative boundary ("not per-PR review").

5 / 5

Distinctiveness Conflict Risk

The sibling boundary is stated twice and is unambiguous: "This is a SIBLING to docs-sync, not a replacement: docs-sync is per-PR (triggered by a diff); this skill is per-corpus (triggered by a maintainer ask)... their triggers MUST NOT collide." Clear niche with minimal conflict risk.

5 / 5

Total

19

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

relative_links

Relative link issues: 8 suspicious

Warning

Total

15

/

16

Passed

Repository

microsoft/apm

Path

.apm/skills/docs-corpus-audit/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.