CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

grade-iterate

Phase 3 of building a Claude Managed Agent — the bounded grade→iterate loop. Define a CMA outcome (a required markdown rubric graded by an isolated grader), read each verdict, decide the next move (sharpen / re-run / promote to schedule), and once a version passes, run held-back eval cases in parallel. Use when the user says "grade my agent", "make it pass the rubric", "iterate until it's good", "is it good enough", or when the orchestrator routes phase=grade-iterate. outcome_builder.py builds the user.define_outcome payload (rubric required, max_iterations clamped 1..20 — never unbounded); verdict_reader.py reads the grader result and recommends the next move; eval_scaffold.py generates held-back cases + a parallel run plan (capped at the 25-thread CMA ceiling). Distinct from stage-launch (first launch) and run-without-you (scheduling).

70

Quality

88%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

75%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-built operational skill body: executable verified commands, an explicit verdict-driven feedback loop with a budget-flip rule, and hard rules that prevent common failure modes (unbounded iteration, grading on seen cases). The deductions are consistent and minor: duplicated Tools/workflow content, a couple of unresolvable references (goal_state.py, ../../references/*.md), and a missing failure branch for held-back eval.

Suggestions

Deduplicate the Tools section against the Workflow steps — either drop the parenthetical restatements ('rubric required, cap 1..20', '≤25 threads') from the Tools bullets or remove the section and rely on the workflow commands, which already carry the same facts.

Add an explicit held-back-eval failure branch to the Workflow or Hard rules (e.g., 'if any held-back case fails, do not ship — sharpen against the failing rubric line and re-run eval') so step 5's SHIP/promote decision has a defined recovery path.

Fix the dangling references: point the loops-and-workflows.md and cma-primitives.md links at files inside the skill bundle (e.g., a references/ directory), and note where goal_state.py lives (or include it) so the step-5 command is executable from this skill.

DimensionReasoningScore

Conciseness

The body is lean, assumes competence, and explains nothing Claude already knows, but the "Tools" section restates facts already given in the Workflow steps — "rubric required, cap 1..20" appears in step 1 and again in the outcome_builder bullet, and "held-back cases + parallel run plan" appears in step 4 and again in the eval_scaffold bullet. This fits the score-4 anchor (efficient, minor instances that could be trimmed); it is not score 5 because that duplicated summary means not every token earns its place, and not score 3 since there is no unnecessary explanation, only minor repetition.

4 / 5

Actionability

All three core commands are fully executable and copy-paste ready (verified: --sheet/--max-iterations/--out, --result, --concurrency flags all exist in the bundled scripts), and the decision table maps concrete statuses to moves. This is the score-4 anchor (mostly executable with minor gaps): "goal_state.py set --phase run-without-you" references a script not present in this bundle, and eval_scaffold.py's --sample path resolves to a nonexistent assets/example-build-sheet.json. It is not score 5 because of those unresolvable references, and not score 3 because nothing is pseudocode or missing key execution details.

4 / 5

Workflow Clarity

The 5-step sequence is clear with explicit validation checkpoints and a real feedback loop: "Read every verdict first", the loop invariant "Each iteration must move ≥1 rubric line fail→pass", and "With ≤1 iteration left it flips to 'make the single highest-value fix or escalate now'". This fits the score-4 anchor (clear sequence, most checkpoints present, minor gap); the gap is that the held-back eval stage has no failure branch — step 4 runs the cases and step 5 decides SHIP/promote, but what to do when a held-back case fails after the in-loop rubric passes is unstated, which keeps it below the score-5 anchor's 'feedback loops for error recovery' for the batch eval stage.

4 / 5

Progressive Disclosure

Good structure: an overview body (~74 lines) with clear sections, and scripts one level deep, all real, listed under "Tools", and referenced with executable commands. This fits the score-4 anchor (good structure, references mostly clear, minor organization gaps); the gap is that the two reference links — [../../references/loops-and-workflows.md] and [../../references/cma-primitives.md] — point two levels outside the skill bundle and no references/ directory exists here, so navigation to the cited material (also cited in the forcing-question library) cannot be verified. It is not score 3 because the references that do exist are clearly signaled and one level deep with nothing inlined that belongs in a separate file.

4 / 5

Total

16

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An exemplary description: concrete capabilities with numeric bounds, an explicit 'Use when' clause with quoted natural trigger phrases, third-person voice, and explicit differentiation from sibling skills. Every dimension sits at its top anchor. The only nit is length (~140 words), but every clause carries capability or trigger information, so no dimension is penalized for padding.

DimensionReasoningScore

Specificity

Lists multiple concrete actions with comprehensive coverage: "Define a CMA outcome (a required markdown rubric graded by an isolated grader), read each verdict, decide the next move (sharpen / re-run / promote to schedule)... run held-back eval cases in parallel", plus tool-level specifics like "max_iterations clamped 1..20" and "capped at the 25-thread CMA ceiling". This matches the score-5 anchor (multiple specific concrete actions, comprehensive coverage); it is not score 4 because no meaningful capability gap remains — even numeric bounds and tool responsibilities are stated.

5 / 5

Completeness

Explicitly answers both questions: what ("Define a CMA outcome... read each verdict, decide the next move... run held-back eval cases in parallel" with per-tool roles) and when ("Use when the user says 'grade my agent'... or when the orchestrator routes phase=grade-iterate"). This is the score-5 anchor verbatim — clear what AND when with concrete trigger phrases; not score 4 since the when-clause is fully explicit, not improvable.

5 / 5

Trigger Term Quality

Quoted natural user phrases cover the phrasing space comprehensively: "grade my agent", "make it pass the rubric", "iterate until it's good", "is it good enough", plus the routing trigger "phase=grade-iterate". This matches the score-5 anchor (comprehensive natural terms including synonyms — grade/rubric/iterate/good enough); score 4 would require identifiable missing natural variants, and none are apparent.

5 / 5

Distinctiveness Conflict Risk

Clear niche ("Phase 3 of building a Claude Managed Agent — the bounded grade→iterate loop") with distinct triggers, and it explicitly names and distinguishes siblings: "Distinct from stage-launch (first launch) and run-without-you (scheduling)". Minimal conflict risk per the score-5 anchor; not score 4 because overlap risk is addressed head-on rather than merely minor.

5 / 5

Total

20

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_field

'metadata' should map string keys to string values

Warning

relative_links

Relative link issues: 2 suspicious

Warning

Total

14

/

16

Passed

Repository

alirezarezvani/claude-skills

Path

agent-launcher/skills/grade-iterate/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.