CtrlK
BlogDocsLog inGet started
Tessl Logo

skill-quality-auditor

Evaluate, score, and remediate agent skill collections using a 9-dimension quality framework (Knowledge Delta, Mindset, Anti-Patterns, Specification Compliance, Progressive Disclosure, Freedom Calibration, Pattern Recognition, Practical Usability, Eval Validation). Performs duplication detection, generates remediation plans with T-shirt sizing, enforces CI quality gates, validates artifact conventions, tracks score trends, and ensures tessl registry compliance. Use when evaluating skill quality, auditing SKILL.md files, scoring agent skills, generating remediation plans, detecting duplicate skills, validating skill format, enforcing quality gates, optimizing for A-grade publication, comparing audit baselines, batch skill assessments, or checking tessl compliance. Triggers: 'check my skills', 'skill audit', 'improve my SKILL.md', 'quality check', 'A-grade scoring', 'quality gates', 'eval validation', 'audit all skills', 'remediation plan', 'skill judge', 'dimension scoring'.

76

Quality

95%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

93%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is an exemplary navigation-hub skill: token-efficient, fully executable commands covering single/batch/PR-scope/all-skills audits, and a clean one-level-deep reference structure with When-to-Use conditions on every link. The main gap is that the workflow's remediation-plan step lacks the concrete command that the other steps have.

Suggestions

Add the remediation-plan generation command to Workflow step 3 (e.g. the bundled scripts/generate-remediation-plan.sh or the equivalent pantheon-skill-auditor subcommand) so every workflow step is executable.

Tighten the Quick Start duplication where "Build once, then audit:" is immediately followed by a "Build once:" line.

Make step 2's "deterministic criteria" concrete or explicitly point to the reference that defines them (e.g. link references/framework-dimensions.md inline).

DimensionReasoningScore

Conciseness

The body is a lean navigation hub: every section carries commands or pointers ("pantheon-skill-auditor evaluate <domain>/<skill-name> --json --store", the NEVER/WHY anti-pattern bullets) with no explanation of concepts Claude already knows and no padding. It matches the level-5 anchor (lean, assumes competence, every token earns its place); the only candidate deduction is the minor formatting stutter where "Build once, then audit:" is immediately followed by a "Build once:" line, but that is duplication of a heading, not over-explanation, so level 4 does not fit better.

5 / 5

Actionability

Quotes: "bun run build:skill-auditor", "pantheon-skill-auditor batch <skill1> <skill2> --fail-below B --store", the PR-scoped triage pipeline using git diff/sed/tr, and the self-audit with expected output "# Expected: A grade, total >= 126/140". Commands are fully executable, copy-paste ready, and cover the common cases (single, batch, PR-scope, all skills, self-audit), matching the level-5 anchor rather than level 4, which would require minor gaps in the shown commands.

5 / 5

Workflow Clarity

Quotes: "1. Run `pantheon-skill-auditor evaluate <skill> --json --store` ... 4. Run the auditor again to verify improvement; if score is below target, check `remediation-plan.md` and focus on the lowest-scoring dimension". The sequence is clear and includes an explicit re-audit feedback loop with conditional recovery, but step 3 ("Generate a remediation plan with T-shirt sizing") has no corresponding command anywhere in the body — the bundled scripts/generate-remediation-plan.sh is never surfaced — and step 2's "deterministic criteria" are unspecified inline. This fits level 4 (clear sequence, most checkpoints present, minor gaps) rather than level 5, and exceeds level 3 because validation via re-audit is explicit.

4 / 5

Progressive Disclosure

The body is an overview hub with two well-organized References tables carrying Topic | Reference | When-to-Use columns (e.g. "Per-dimension criteria and bonus rules | [Dimensions](references/framework-dimensions.md) | Evaluating any dimension"), and all 12 referenced files exist in references/. References are one level deep — the cross-links found inside reference files are illustrative template examples inside fenced code blocks, not nested navigation — matching the level-5 anchor of a clear overview with well-signaled one-level-deep references and easy navigation.

5 / 5

Total

19

/

20

Passed

Description

96%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: third-person, dense with concrete capabilities, and equipped with both an explicit 'Use when' clause and a separate natural-language trigger list. The only weakness is a handful of generic trigger terms ('quality check', 'quality gates') that create minor overlap risk with code-quality skills.

Suggestions

Scope the generic triggers, e.g. change "'quality check'" to "'skill quality check'" and "'quality gates'" to "'skill quality gates'", to eliminate overlap with code-quality/CI skills.

Trim the trigger list's near-duplicates (e.g. 'quality gates' appears in both the 'Use when' clause and the trigger list) to reduce padding without losing coverage.

DimensionReasoningScore

Specificity

Quotes: "Evaluate, score, and remediate agent skill collections", "Performs duplication detection, generates remediation plans with T-shirt sizing, enforces CI quality gates, validates artifact conventions, tracks score trends, and ensures tessl registry compliance". It lists multiple specific concrete actions with comprehensive coverage of the skill's capabilities, matching the level-5 anchor; it exceeds level 4 because the gaps are not minor — the action list covers evaluation, remediation, duplication, CI gating, conventions, trends, and compliance. Third-person voice ("Evaluate", "Performs") is used throughout, so no voice penalty applies.

5 / 5

Completeness

Quotes: "Evaluate, score, and remediate agent skill collections using a 9-dimension quality framework..." (what) and "Use when evaluating skill quality, auditing SKILL.md files... or checking tessl compliance" (when, with concrete trigger phrases). Both what and when are explicitly and clearly answered, matching the level-5 anchor; level 4 would require the 'when' to be less explicit or specific, which is not the case here.

5 / 5

Trigger Term Quality

Quotes: "Use when evaluating skill quality, auditing SKILL.md files, scoring agent skills, generating remediation plans..." plus an explicit trigger list: "'check my skills', 'skill audit', 'improve my SKILL.md', 'quality check', 'A-grade scoring', 'audit all skills', 'remediation plan', 'skill judge'". This covers natural user phrasings, synonyms, and concrete file artifacts (SKILL.md), matching the comprehensive level-5 anchor rather than level 4, where a few natural terms would be missing.

5 / 5

Distinctiveness Conflict Risk

Quotes: "auditing SKILL.md files", "tessl registry compliance", "9-dimension quality framework" establish a clear niche, but the trigger terms "'quality check'" and "'quality gates'" are generic and could plausibly fire for code-quality or CI skills. This fits the level-4 anchor (mostly distinct, minor overlap risk with closely related skills) rather than level 5, because the generic quality triggers are not minimal-risk; it is above level 3 since the skill-scoped terms (SKILL.md, skill audit, tessl) make wrong-skill triggering unlikely in most contexts.

4 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository
pantheon-org/tekhne
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.