CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl-labs/skill-optimizer

Optimize your skills and tiles: review SKILL.md quality, generate eval scenarios, run evals, compare across models, diagnose gaps, and re-run until scores improve.

88

1.07x
Quality

94%

Does it follow best practices?

Impact

88%

1.07x

Average score across 24 eval scenarios

SecuritybySnyk

Passed

No known issues

Overview
Quality
Evals
Security
Files

criteria.jsonevals/scenario-9/

{
  "context": "Tests whether the agent produces a Phase 7 score comparison in the required format — overall before/after with percentage delta, per-dimension breakdown, and explanation of which dimensions improved and why. Covers the specific score comparison output format prescribed by the skill.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "Overall before/after format",
      "description": "Report includes the overall score in 'Before: X% | After: Y% (+Z%)' format (or equivalent showing both scores and the delta together in one line or heading)",
      "max_score": 12
    },
    {
      "name": "Percentage delta shown",
      "description": "Report shows the numeric improvement delta (+31% in this case) alongside or near the before/after scores",
      "max_score": 10
    },
    {
      "name": "Per-dimension breakdown",
      "description": "Report includes a per-dimension section covering all four dimensions from the review (Completeness, Actionability, Conciseness, Robustness)",
      "max_score": 10
    },
    {
      "name": "Arrow notation or equivalent",
      "description": "Per-dimension entries show both old and new scores with a directional indicator (e.g. '1/3 → 3/3' or 'was 33%, now 100%')",
      "max_score": 8
    },
    {
      "name": "Dimension change labelled",
      "description": "Each dimension entry mentions what change caused the score to improve (e.g. 'added Use when clause', 'added executable code examples')",
      "max_score": 10
    },
    {
      "name": "Dimensions impact explained",
      "description": "Report explains which dimensions improved and why those changes matter — not just numbers",
      "max_score": 10
    },
    {
      "name": "Correct overall scores",
      "description": "Report accurately states Before: 58%, After: 89%, delta: +31%",
      "max_score": 8
    },
    {
      "name": "Completeness improvement noted",
      "description": "Report notes Completeness improved from 1/3 (33%) to 3/3 (100%) and attributes it to the Use when clause",
      "max_score": 8
    },
    {
      "name": "Actionability improvement noted",
      "description": "Report notes Actionability improved from 2/3 (66%) to 3/3 (100%) and attributes it to real executable examples",
      "max_score": 8
    },
    {
      "name": "Conciseness unchanged noted",
      "description": "Report notes that Conciseness stayed at 2/3 (66%) and did not change between before and after",
      "max_score": 8
    },
    {
      "name": "Robustness improvement noted",
      "description": "Report notes Robustness improved from 2/3 (66%) to 3/3 (100%)",
      "max_score": 8
    }
  ]
}

evals

README.md

tile.json