CtrlK
BlogDocsLog inGet started
Tessl Logo

tessl-labs/skill-optimizer

Optimize your skills and tiles: review SKILL.md quality, generate eval scenarios, run evals, compare across models, diagnose gaps, and re-run until scores improve.

88

1.07x
Quality

94%

Does it follow best practices?

Impact

88%

1.07x

Average score across 24 eval scenarios

SecuritybySnyk

Passed

No known issues

Overview
Quality
Evals
Security
Files

criteria.jsonevals/scenario-18/

{
  "context": "Testing whether an agent correctly handles downloading scenarios when multiple commits were passed to tessl scenario generate — where --last only downloads the most recent generation and specific IDs are needed for each commit.",
  "type": "weighted_checklist",
  "checklist": [
    {
      "name": "does_not_use_last_only",
      "description": "The agent does NOT simply run `tessl scenario download --last`, which would only download scenarios from one of the two commits.",
      "max_score": 30
    },
    {
      "name": "finds_generation_ids",
      "description": "The agent either uses `tessl scenario list` to find the generation IDs, or instructs the user to use the Scenario IDs shown in the generate output.",
      "max_score": 20
    },
    {
      "name": "downloads_each_separately",
      "description": "The agent downloads scenarios for each commit separately using specific generation IDs (e.g., `tessl scenario download <id1>` then `tessl scenario download <id2>`).",
      "max_score": 30
    },
    {
      "name": "explains_why",
      "description": "The agent explains that each commit produced its own generation with its own ID, and `--last` only gets the most recent one.",
      "max_score": 20
    }
  ]
}

evals

README.md

tile.json