CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

apm-spec-guardian

Use this skill to run a four-panel adversarial advisory review on any pull request that touches the OpenAPM specification artifact (docs/src/content/docs/specs/openapm-*.md), its inline / sidecar JSON Schemas (docs/src/content/docs/specs/schemas/*.schema.json), or the conformance fixture seed (tests/fixtures/spec-conformance/**). The panel fans out to four spec-ecosystem reviewers (swagger-openapi-editor, oci-distribution-editor, pkgmgr-registry-contract-editor, w3c-tag-architect), each running in its own agent thread, and a spec-editor synthesizer that produces a fold-now / defer-v0.1.1 / defer-v0.2 / reject list plus a ship decision keyed off a 1..10 shocked_meter scale. The orchestrator is the sole writer to the PR: ONE consolidated comment, no verdict labels, no merge gating. The panel is advisory -- it surfaces findings, prioritizes folds, and renders a ship recommendation that the maintainer weighs.

70

Quality

88%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

81%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

This is a highly actionable, well-sequenced orchestration skill with explicit validation loops, exact thresholds, and verbatim prompts -- among the strongest workflow content one could ask for. Its weaknesses are repetition (the advisory/single-writer/ASCII rules are restated many times) and an inline-heavy structure that keeps prompt templates in SKILL.md instead of the already-established assets directory.

Suggestions

State the advisory regime, single-writer interlock, and ASCII/no-vendor rules once in 'Architecture invariants' and reference them by name from the wave sections and output contract instead of restating them in full -- the gotchas section alone re-explains three invariants verbatim.

Move the verbatim Wave 3 and Wave 4 task-prompt passages (severity contract, no-vendor rule, ASCII rule, output contract) into assets/ alongside the schemas and templates (e.g. assets/panelist-prompt.md, assets/synthesizer-prompt.md), keeping SKILL.md as the orchestration overview.

Trim the topology ASCII diagram to the wave sequence and move the per-wave detail already covered by the wave sections; the diagram currently duplicates Wave 0 classification rules nearly line-for-line.

DimensionReasoningScore

Conciseness

The body is dense with genuinely non-obvious operational detail (no filler explaining concepts Claude already knows), but core rules are restated far beyond what is needed: the advisory regime appears at least six times ('This skill is ADVISORY by design', 'The panel is advisory', repeated in Waves 3/4/5/6, the output contract, and the gotchas), and the single-writer, ASCII, and no-vendor rules each repeat 3-4 times across invariants, wave prompts, output contract, and gotchas. This is more than 'minor instances that could be trimmed', so it sits at the mostly-efficient-but-could-be-tightened anchor rather than 4.

3 / 5

Actionability

Fully executable orchestration guidance: exact marker line 'apm-spec-guardian: new-version', exact thresholds ('shocked_meter_avg >= 7.0', 'diff added < 50 lines AND removed < 50 lines'), exact label to sweep ('spec-review'), verbatim prompt passages to include in each task ('Use new_blocking_findings ONLY for issues that would break a conformant implementation...'), and named JSON schemas per return. An agent can follow this without inventing anything.

5 / 5

Workflow Clarity

The multi-step process is explicitly sequenced (Wave 0 scope decision with ordered decision rules, Waves 1-6) with a topology diagram, and validation checkpoints with feedback loops are everywhere: schema-validate each panelist return, re-spawn on malformed JSON ('max 2 attempts; then placeholder'), linter with pass/fail per check, loop budgets with explicit escalation semantics. This matches the top anchor including error-recovery loops.

5 / 5

Progressive Disclosure

All four referenced bundle files exist and are one level deep with clearly signaled purposes (assets/panelist-return-schema.json, assets/synthesizer-return-schema.json, assets/linter-checklist.md, assets/comment-template.md), and the persona roster points at ../../agents/*.agent.md. However, the verbatim Wave 3/Wave 4 prompt passages and the roster table are inlined in SKILL.md where they could live in assets alongside the other templates, and the body is a single ~375-line orchestration spec rather than an overview pointing to split materials. Good structure, minor organization gaps -- the anchor-4 fit.

4 / 5

Total

17

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is a strong example: it states exactly what the skill does and exactly when it fires, with concrete reviewer names, output artifacts, a numeric decision scale, and path-scoped triggers that eliminate conflict risk. The only small gap is that a couple of natural trigger phrasings are conveyed through globs rather than plain words.

DimensionReasoningScore

Specificity

Multiple concrete actions are named with precise artifacts: 'run a four-panel adversarial advisory review', 'fans out to four spec-ecosystem reviewers (swagger-openapi-editor, oci-distribution-editor, pkgmgr-registry-contract-editor, w3c-tag-architect)', 'produces a fold-now / defer-v0.1.1 / defer-v0.2 / reject list plus a ship decision keyed off a 1..10 shocked_meter scale', 'ONE consolidated comment, no verdict labels, no merge gating'. Coverage is comprehensive and nothing is padded fluff; not 4 because there are no minor gaps in the action inventory.

5 / 5

Completeness

Explicitly answers both questions: what ('fans out to four... reviewers... and a spec-editor synthesizer that produces a fold-now / defer... / reject list plus a ship decision', 'the orchestrator is the sole writer to the PR') and when ('Use this skill to run... on any pull request that touches the OpenAPM specification artifact (docs/src/content/docs/specs/openapm-*.md), its inline / sidecar JSON Schemas...'). The 'Use this skill' clause with concrete trigger paths matches the top anchor exactly.

5 / 5

Trigger Term Quality

Good natural-term coverage: 'pull request that touches', 'specification artifact', 'JSON Schemas', 'conformance fixture', plus concrete file extensions/globs ('openapm-*.md', '*.schema.json'). A few natural phrases a user might say ('spec review', 'review the spec changes', 'schema changes') are only implied via the path globs, so it falls just under the comprehensive-with-synonyms anchor.

4 / 5

Distinctiveness Conflict Risk

Clear niche with distinct triggers: activation is pinned to three exact path globs ('docs/src/content/docs/specs/openapm-*.md', 'docs/src/content/docs/specs/schemas/*.schema.json', 'tests/fixtures/spec-conformance/**') and it distinguishes itself from general PR review ('The panel is advisory'). No other skill would plausibly trigger on these paths.

5 / 5

Total

19

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

relative_links

Relative link issues: 5 suspicious

Warning

Total

15

/

16

Passed

Repository

microsoft/apm

Path

.apm/skills/apm-spec-guardian/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.