CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl/skill-optimizer

Optimize your skills and plugins: review SKILL.md quality, generate eval scenarios, run evals, compare across models, diagnose gaps, and re-run until scores improve.

88

1.14x
Quality

87%

Does it follow best practices?

Impact

89%

1.14x

Average score across 29 eval scenarios

SecuritybySnyk

Advisory

Suggest reviewing before use

Overview
Quality
Evals
Security
Files

criteria.jsonevals/scenario-26/

{
  "context": "Tests whether the agent runs tessl plugin lint after applying fixes, checks for token cost increases, and recommends moving heavy content to docs (on-demand) rather than rules (always loaded) when front-loaded tokens balloon. This covers the Phase 3.3 lint-after-each-fix instruction from optimize-skill-performance.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "tessl plugin lint command used",
      "description": "Script uses tessl plugin lint as the command for plugin validation (not tessl lint plugin, tessl validate, or other variants)",
      "max_score": 22
    },
    {
      "name": "Plugin path argument provided",
      "description": "Script passes the plugin path (./database-migrator/ or equivalent) as an argument to tessl plugin lint",
      "max_score": 10
    },
    {
      "name": "Lint run after each change set",
      "description": "Script runs tessl plugin lint at least twice — once after each distinct set of changes (i.e., there is more than one lint invocation, not a single final lint)",
      "max_score": 15
    },
    {
      "name": "Token cost ballooning flagged",
      "description": "Script or notes include logic or commentary that flags when front-loaded token costs increase significantly — not just that lint passes or fails",
      "max_score": 14
    },
    {
      "name": "Move to docs recommended",
      "description": "validation-notes.md recommends moving heavy content to docs (or equivalent on-demand storage) when front-loaded tokens increase significantly",
      "max_score": 20
    },
    {
      "name": "Docs vs rules distinction",
      "description": "validation-notes.md explicitly distinguishes between docs (loaded on-demand) and rules (always loaded) — and states that heavy content should go to docs, not rules",
      "max_score": 14
    },
    {
      "name": "Does NOT recommend rules for heavy content",
      "description": "Script and notes do NOT recommend keeping large additions in rules or SKILL.md inline when token costs have ballooned",
      "max_score": 5
    }
  ]
}

README.md

tile.json