CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

sy-eval-report

Generate closure proof with exact commands, outcomes, artifact paths, untested lanes, and residual risk. Use when work and review need a receipt before closeout, release, tracker movement, or handoff.

Quality

84%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

78%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is exceptionally lean and well-structured with genuine one-level-deep references and explicit fail-fast checkpoints, but the core eval work remains direction rather than instruction: no actual commands, no example stage-result artifact, and an unspecified notion of what counts as a validation gate. As an instruction-only orchestration skill its routing rules are specific, yet the executable heart of the stage is left implicit.

Suggestions

Replace "Run the smallest relevant local check for changed files" and "run plugin validation and SDK proof commands from the repository wrapper" with the actual commands or exact script paths, so the validation step is executable rather than directional.

Add a minimal example of the stage-result artifact (JSON with schema_version, stage, status, evidence_refs, blocked_by, next_stage) so the required output format is concrete and copy-paste ready.

Specify which lanes must be pass before handoff (i.e., what constitutes a required gate for eval-report) to close the workflow's validation gap.

DimensionReasoningScore

Conciseness

The body is lean and telegraphic across all nine sections — e.g., "Fail fast: stop at the first failed required gate" — with no re-teaching of concepts Claude already knows; every Gotcha is harness-specific and earns its place. The only near-redundancy is the one-line "When to use" restating the frontmatter description, which is structural convention rather than the over-explanation of anchor 4.

5 / 5

Actionability

Concrete anchors exist — the Deliverables section names artifact fields ("schema_version, stage, status, evidence_refs, blocked_by, and next_stage") and exact status vocabulary ("pass, fail, blocked, or not_checked") — but the operational core stays abstract: "Run the smallest relevant local check for changed files" and "run plugin validation and SDK proof commands from the repository wrapper" name no actual commands, and no example stage-result artifact is given. Above anchor 2 (more than high-level hints), below anchor 4 (missing executable specifics).

3 / 5

Workflow Clarity

The five-step Procedure is clearly sequenced, with an explicit fail-fast checkpoint ("stop at the first failed required gate... do not proceed to downstream stages until the failure is resolved or explicitly waived") and error-recovery routing in Failure modes ("blocker with the smallest recovery step"). Not 5 because the validation step itself is generic — which check to run and what constitutes a gate is never specified, leaving a minor validation gap.

4 / 5

Progressive Disclosure

A lean ~55-line overview body with clear section headers and a References section pointing one level deep to four labeled files (contract, evals, task profile, source context), all verified to exist with real content rather than nested pointer stubs. References are well-signaled with purpose labels and navigation is easy, matching the anchor-5 structure.

5 / 5

Total

17

/

20

Passed

Description

83%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description that explicitly states both what the skill produces and when to use it, with mostly natural trigger terms and a distinct niche. Its weaknesses are reliance on internal jargon ("closure proof", "untested lanes") and broad terms like "release"/"handoff" that carry some conflict risk with adjacent lifecycle skills.

DimensionReasoningScore

Specificity

Enumerates several concrete deliverables — "exact commands, outcomes, artifact paths, untested lanes, and residual risk" — but describes a single action ("Generate closure proof") plus its contents, and "closure proof"/"untested lanes" are internal jargon, falling short of anchor 5's comprehensive coverage of distinct concrete actions. It is well above anchor 3's 1-2 concrete actions.

4 / 5

Completeness

Explicitly answers both: what ("Generate closure proof with exact commands, outcomes, artifact paths, untested lanes, and residual risk") and when ("Use when work and review need a receipt before closeout, release, tracker movement, or handoff") with concrete trigger phrases. This matches the anchor-5 pattern; the when-clause is fully explicit, so it exceeds anchor 4.

5 / 5

Trigger Term Quality

"closeout, release, tracker movement, or handoff" plus "receipt" and "residual risk" are natural phrases a target user would say, giving good keyword coverage. Not 5 because common synonyms are missing (e.g., "signoff", "validation report", "release notes") and no variations of the core request are offered; not 3 because coverage is good rather than partial.

4 / 5

Distinctiveness Conflict Risk

"closure proof" and "receipt before closeout" carve a distinct niche with domain-specific triggers, but "release" and "handoff" are broad terms that could overlap with adjacent lifecycle or reporting skills — mostly distinct with minor overlap risk. Not 5 (some generic trigger words remain); clearly above anchor 3's overlap-with-similar-skills level.

4 / 5

Total

17

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

jscraik/Agent-Skills

Path

Plugins/synaipse-harness/skills/sy-eval-report/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.