CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

collection-compliance

Diagnose and fix `.catalog/` validation failures (schema, roster, banners, sample workflows, JSON mirror). Use when: - `make validate` or CI reports collection compliance errors - A PR adds skills but catalog was not updated - `collection.json` is out of sync with `collection.yaml` - Catalog metadata/fragments might have drifted from README/CLAUDE/SKILL golden sources Remediation is via the create-collection workflow and `catalog_yaml_to_json.py`—not by weakening checks.

Quality

91%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

96%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

An exceptionally lean, actionable runbook: every step is executable, the workflow closes with an explicit re-validation loop, and detail is delegated to COLLECTION_SPEC.md. The only weakness is that a few spec rules are restated inline, slightly blurring the overview-vs-reference split.

DimensionReasoningScore

Conciseness

The body is dense operational content only — exact script invocations, thresholds ("over **500** code points"), field names, and failure conditions — with zero explanation of concepts Claude already knows and no padded sections. Every line carries repo-specific information that earns its place.

5 / 5

Actionability

Commands are copy-paste ready throughout: `uv run python scripts/validate_collection_compliance.py`, `uv run python scripts/bootstrap_catalog.py --plugin <plugin>`, `uv run python scripts/catalog_yaml_to_json.py --plugin <plugin>`, `make catalog-mirror-json`, and a concrete Example usage block covering the common case (rh-developer). Classification criteria give exact rules (refs must start with `#`, `name == <n>`, GREEN/ORANGE maturity).

5 / 5

Workflow Clarity

The four-step workflow has an explicit validate→fix→re-validate feedback loop (step 1 re-run and capture errors, step 4 "Re-validate — `make validate-collection-compliance`"), a classification checklist for error recovery, and explicit fail conditions for the semantic review ("Fail review if any of these drift conditions are found"). Validation checkpoints are present, so no cap applies.

5 / 5

Progressive Disclosure

Sections are well organized and [COLLECTION_SPEC.md](../../COLLECTION_SPEC.md) is a clearly signaled, one-level-deep reference used consistently for full spec detail. However, some spec-level policy text (fragment provenance banner rules, thin deploy_and_use MCP criteria) is inlined rather than fully delegated, which is a minor organization gap rather than the clean split of a 5.

4 / 5

Total

19

/

20

Passed

Description

87%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it states a precise what, gives an explicit multi-trigger 'Use when' clause, and closes with the remediation path. Trigger coverage is good though not exhaustive of every natural phrasing, which is the only minor gap.

DimensionReasoningScore

Specificity

"Diagnose and fix `.catalog/` validation failures (schema, roster, banners, sample workflows, JSON mirror)" names the domain and enumerates concrete failure scopes, and remediation names the create-collection workflow and `catalog_yaml_to_json.py`. It lists several specific actions with minor gaps rather than the comprehensive action coverage of a 5.

4 / 5

Completeness

It explicitly answers both: "Diagnose and fix `.catalog/` validation failures (schema, roster, banners, sample workflows, JSON mirror)" states the what, and a "Use when:" clause with four concrete trigger scenarios states the when. This matches the anchor for clear and explicit what AND when with concrete trigger phrases.

5 / 5

Trigger Term Quality

Triggers like "`make validate` or CI reports collection compliance errors", "A PR adds skills but catalog was not updated", and "`collection.json` is out of sync with `collection.yaml`" are natural contributor phrasings with good keyword coverage. A few natural terms/synonyms (e.g., marketplace, maturity, banner/roster error phrasings) are absent, keeping it below comprehensive coverage.

4 / 5

Distinctiveness Conflict Risk

The niche is clear and narrow (`.catalog/` collection compliance validation failures) with distinct triggers (make validate/CI failures, catalog JSON/YAML drift). The mention of the create-collection workflow is remediation guidance, not trigger overlap, so conflict risk is minimal.

5 / 5

Total

18

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

relative_links

Relative link issues: 4 suspicious

Warning

referenced_paths_exist

Referenced path issues: 6 missing

Warning

Total

13

/

16

Passed

Repository

RHEcosystemAppEng/agentic-plugins

Path

.claude/skills/collection-compliance/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.