CtrlK
BlogDocsLog inGet started
Tessl Logo

pantheon-ai/skill-quality-auditor

Audit and improve skill collections with an 8-dimension scoring framework, duplication detection, remediation planning, and CI quality gates; use when evaluating skill quality, generating remediation plans, validating report format, or enforcing repository-wide skill artifact conventions.

Does it follow best practices?

Evaluation93%

1.33x

Agent success when using this tile

Validation for skill structure

Overview
Skills
Evals
Files

quality-thresholds-scoring.mdreferences/

category:
framework
priority:
CRITICAL
source:
scoring rubric analysis

Quality Gates and Scoring Thresholds

Complete scoring framework and threshold interpretation for skill quality assessment.

Quality Gates and Thresholds

Score RangeGradeStatusAction Required
108+AProduction ReadyTessl registry eligible
96-107B+Good QualityMinor improvements
84-95B/C+PassingRemediation recommended
70-83CBelow StandardMajor improvements required
<70FFailingComplete rework needed

Score Interpretation

  • Knowledge Delta drives overall score - prioritize this dimension first
  • Anti-patterns prevent catastrophic failures - second priority
  • Progressive disclosure improves usability - third priority
  • Specification compliance ensures consistency - foundational requirement

Dimension Weighting

DimensionMax PointsPriorityFocus Area
Knowledge Delta20HIGHESTExpert-only content
Mindset + Procedures15HIGHPhilosophy + workflows
Anti-Pattern Quality15HIGHNEVER + WHY + consequences
Practical Usability15HIGHConcrete examples
Specification Compliance15MEDIUMDescription field critical
Progressive Disclosure15MEDIUMHub + references
Freedom Calibration15MEDIUMAppropriate rigidity
Pattern Recognition10LOWActivation keywords

A-Grade Requirements (≥108)

Critical Success Factors

  1. Knowledge Delta ≥17/20: Expert content with <10% redundancy
  2. Anti-Patterns ≥13/15: Multiple NEVER statements with consequences
  3. Progressive Disclosure ≥13/15: Navigation hub + references structure
  4. Strong Activation: Comprehensive description with trigger keywords

Common A-Grade Patterns

  • Scores consistently 13+ across most dimensions
  • Knowledge Delta typically 16-19 points
  • Perfect or near-perfect specification compliance
  • Clear navigation with references directory

Improvement Priority Matrix

High Impact, Low Effort

  • Add missing NEVER statements to anti-patterns
  • Enhance description field with activation keywords
  • Create proper references directory structure
  • Add concrete code examples

High Impact, High Effort

  • Restructure for progressive disclosure (hub approach)
  • Add expert-only content to boost Knowledge Delta
  • Create comprehensive workflow documentation
  • Develop specialized troubleshooting guides

Medium Priority

  • Improve freedom calibration balance
  • Enhance practical usability examples
  • Refine mindset and procedure clarity
  • Optimize pattern recognition triggers

Score Optimization Strategies

For 90-105 Range (B/B+ → A)

Focus on the "Big 3": Knowledge Delta, Anti-Patterns, Progressive Disclosure

For 80-90 Range (C+ → B)

Address specification compliance and practical usability first

For <80 Range (Failing)

Complete restructure required - start with navigation hub and expert content

Install with Tessl CLI

npx tessl i pantheon-ai/skill-quality-auditor@0.1.4

SKILL.md

tile.json