CtrlK
BlogDocsLog inGet started
Tessl Logo

pantheon-ai/skill-quality-auditor

Audit and improve skill collections with a 9-dimension scoring framework (Knowledge Delta, Mindset, Anti-Patterns, Specification Compliance, Progressive Disclosure, Freedom Calibration, Pattern Recognition, Practical Usability, Eval Validation), duplication detection, remediation planning, baseline comparison, and CI quality gates; use when evaluating skill quality, generating remediation plans, detecting duplicates, validating artifact conventions, or enforcing publication thresholds.

93

1.26x
Quality

89%

Does it follow best practices?

Impact

99%

1.26x

Average score across 5 eval scenarios

SecuritybySnyk

Passed

No known issues

Overview
Quality
Evals
Security
Files

quality-thresholds-scoring.mdreferences/

category:
framework
priority:
CRITICAL
source:
scoring rubric analysis

Quality Gates and Scoring Thresholds

Complete scoring framework and threshold interpretation for skill quality assessment.

Quality Gates and Thresholds

Score RangeGradeStatusAction Required
126+AProduction ReadyTessl registry eligible
112-125B/B+Good QualityMinor improvements
98-111C/C+PassingRemediation recommended
91-97DBelow StandardMajor improvements required
<91FFailingComplete rework needed

Score Interpretation

  • Knowledge Delta drives overall score - prioritize this dimension first
  • Anti-patterns prevent catastrophic failures - second priority
  • Progressive disclosure improves usability - third priority
  • Specification compliance ensures consistency - foundational requirement

Dimension Weighting

DimensionMax PointsPriorityFocus Area
Knowledge Delta20HIGHESTExpert-only content
Eval Validation20HIGHESTRuntime validation via tessl evals
Mindset + Procedures15HIGHPhilosophy + workflows
Anti-Pattern Quality15HIGHNEVER + WHY + consequences
Practical Usability15HIGHConcrete examples
Specification Compliance15MEDIUMDescription field critical
Progressive Disclosure15MEDIUMHub + references
Freedom Calibration15MEDIUMAppropriate rigidity
Pattern Recognition10LOWActivation keywords

A-Grade Requirements (>=126)

Critical Success Factors

  1. Knowledge Delta >=17/20: Expert content with <10% redundancy
  2. Eval Validation >=17/20: Complete evals with >=80% instruction coverage
  3. Anti-Patterns >=13/15: Multiple NEVER statements with consequences
  4. Progressive Disclosure >=13/15: Navigation hub + references structure
  5. Strong Activation: Comprehensive description with trigger keywords

Common A-Grade Patterns

  • Scores consistently 13+ across most dimensions
  • Knowledge Delta typically 16-19 points
  • Perfect or near-perfect specification compliance
  • Clear navigation with references directory

Improvement Priority Matrix

High Impact, Low Effort

  • Add missing NEVER statements to anti-patterns
  • Enhance description field with activation keywords
  • Create proper references directory structure
  • Add concrete code examples
  • Create eval scenarios using creating-eval-scenarios skill

High Impact, High Effort

  • Restructure for progressive disclosure (hub approach)
  • Add expert-only content to boost Knowledge Delta
  • Create comprehensive workflow documentation
  • Develop specialized troubleshooting guides
  • Achieve >=80% instruction coverage in evals

Medium Priority

  • Improve freedom calibration balance
  • Enhance practical usability examples
  • Refine mindset and procedure clarity
  • Optimize pattern recognition triggers

Score Optimization Strategies

For 105-125 Range (B/B+ -> A)

Focus on the "Big 4": Knowledge Delta, Eval Validation, Anti-Patterns, Progressive Disclosure

For 98-104 Range (C/C+ -> B)

Address specification compliance, practical usability, and create eval scenarios first

For <98 Range (Failing)

Complete restructure required - start with navigation hub, expert content, and eval scenarios

SKILL.md

tile.json