CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

compass-manifest-maintenance

Author and maintain Compass catalog-info.yaml manifests for agent plugins (skills, plugins, Locations, MCP inverse relations). Use when: - Adding or updating a skill and its Compass manifest - Registering an existing plugin in Compass (manifests only; not creating a new agent plugin) - MCP usage or orchestration changed in SKILL.md - Auditing bidirectional dependsOn/dependencyOf drift against repo Compass conventions File-based only: Read/Glob/Grep/Bash. For `.catalog/` marketplace metadata use create-collection. NOT for: `.catalog/` metadata (use create-collection) or automated Compass registration.

Quality

88%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

88%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

This is a strong operational skill: concrete golden-source precedence rules, exact manifest field values, runnable validation commands, feedback loops for every failure mode, and real one-level-deep reference and template files. Its only real weakness is redundancy — the no-MCP-file-based point and the docs/→references/ migration procedure are each repeated several times across sections, which inflates tokens without adding information.

DimensionReasoningScore

Conciseness

The body is dense with genuinely non-obvious repo rules (lifecycle precedence, inverse-manifest parity, namespace conventions) and assumes Claude's competence — it never explains what Compass/Backstage is. However, the docs/→references/ migration procedure is restated four times (workflow §1.8, Error Handling, Self-review checklist, Common Issues) and the "file-based, no MCP tools" point three times (Prerequisites, Workflow, Dependencies), which is minor trimming, matching anchor 4 rather than 5's "every token earns its place".

4 / 5

Actionability

Fully executable, copy-paste-ready commands are given ("uv run python scripts/validate_compass_manifests.py", "make validate", the comm/find/grep roster snippets, the four-plugin audit loop), manifest fields are enumerated with exact values ("namespace: ai5-marketplace", "owner: group:redhat/ai5-marketplace"), and real template files exist in assets/. This matches anchor 5; anchor 4's "minor gaps" do not apply — even the shell snippets are parameterized and complete.

5 / 5

Workflow Clarity

Section 1 gives a clearly sequenced 8-step process with explicit validation checkpoints (verify repo root test, validate_compass_manifests.py, Tier 1 lint), an Error Handling section mapping each failure to a fix (a validate→fix→re-run feedback loop for a batch multi-file operation), an audit rules table, and a self-review checklist — exactly anchor 5. The destructive batch operation (deleting docs/, editing many manifests) is well covered by validation, so the workflow-clarity cap at 3 does not apply.

5 / 5

Progressive Disclosure

References are one level deep, clearly signaled, and verified to exist: references/relationship-rules.md, references/mcp-mapping.md, and all three assets/ templates match real bundle files; body links resolve. Structure is good, but a sizable procedural block (the full docs/→references/ migration rules and the audit table) is inlined in SKILL.md where it could live in a reference file, so anchor 4 ("most content appropriately placed; minor organization gaps") fits better than 5's clean overview split.

4 / 5

Total

18

/

20

Passed

Description

87%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is a strong exemplar: it states what the skill does, gives four concrete trigger scenarios, and explicitly fences off the neighboring create-collection skill and plugin-creation cases. Third-person voice is used and no over-claiming is present; the only weakness is slightly more compression than detail on the specific actions.

DimensionReasoningScore

Specificity

"Author and maintain Compass catalog-info.yaml manifests for agent plugins (skills, plugins, Locations, MCP inverse relations)" names the domain and several concrete actions (author, maintain, register, audit drift) with only minor gaps — it never states what maintain concretely touches beyond dependsOn/dependencyOf edges. Anchor 4 ("lists several specific actions; minor gaps in coverage") fits better than 5, whose examples enumerate a fuller set of concrete operations.

4 / 5

Completeness

The "what" is explicit ("Author and maintain Compass catalog-info.yaml manifests for agent plugins") and the "when" is a concrete four-item "Use when" list, plus an explicit "NOT for" boundary. This clearly matches anchor 5 ("clearly and explicitly answers both what AND when with concrete trigger phrases"); anchor 4's weaker/implicit "when" does not apply.

5 / 5

Trigger Term Quality

Natural trigger phrases a maintainer would say are present — "Adding or updating a skill and its Compass manifest", "Registering an existing plugin", "MCP usage or orchestration changed", "dependsOn/dependencyOf drift" — plus the exact filename catalog-info.yaml. A few natural variants are missing (e.g. "Backstage", "catalog registration"), so anchor 4 ("good keyword coverage; a few natural terms missing") rather than 5's comprehensive synonym coverage.

4 / 5

Distinctiveness Conflict Risk

A narrow niche (Compass/Backstage manifest maintenance) with explicit disambiguation — "NOT for: .catalog/ metadata (use create-collection) or automated Compass registration" and "manifests only; not creating a new agent plugin". Clear niche with distinct triggers and minimal conflict risk, matching anchor 5.

5 / 5

Total

18

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

relative_links

Relative link issues: 1 suspicious

Warning

referenced_paths_exist

Referenced path issues: 13 missing

Warning

Total

13

/

16

Passed

Repository

RHEcosystemAppEng/agentic-plugins

Path

.claude/skills/compass-manifest-maintenance/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.