CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

realize

This skill should be used when the user asks to "run the eval", "test whether the protocol actually works at runtime", "check type realization", "measure protocol fulfillment", "run the type-realization suite", "does the gate actually stop", or wants runtime evidence that a protocol's formal transition contract is realized rather than an assessment of downstream artifact quality. Invoke explicitly with /realize and a skill argument.

Quality

77%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./.claude/skills/realize/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

75%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A dense, expert-level body: executable workflow commands for both runners, explicit integrity and failure semantics, and well-signaled one-level-deep references with a clean Additional Resources section. The remaining gaps are minor — rationale passages that could be deferred, inlined reference-grade detail in 'Cases' and 'Reading results', and an unstated recovery step for integrity failures.

Suggestions

Trim or defer the sham-arm publication rationale and the codex token-rotation explanation to grader-design.md / runbook.md, keeping one operational sentence each in SKILL.md.

Move the per-target manual-column enumerations (inquire/grasp/conduct lists) in 'Reading results' into runbook.md, keeping a one-line summary per target in the body.

Add one line stating the recovery action when a row's integrity falls short of its run count (e.g. re-run that arm) to close the feedback loop.

DimensionReasoningScore

Conciseness

The body is dense and operational with zero padding of concepts Claude already knows — no basic explanations anywhere. A few justification passages, such as the sham-arm rationale ("Published work on rule files for coding agents found random rules helping as much as curated ones, which makes 'a long structured instruction is present' a live alternative explanation") and the ChatGPT-login refresh-token rotation explanation, carry argumentation that could be trimmed or deferred to a reference. That places it at 'efficient; minor instances of over-explanation that could be trimmed' — not level 5's 'every token earns its place', well above level 3's 'some unnecessary explanation'.

4 / 5

Actionability

The Workflow section gives copy-paste-ready commands for both runners ('cd .claude/skills/realize/scripts', './setup.sh inquire', 'REALIZE_RUNNER=codex ./run.sh inquire', './teardown.sh inquire'), and the one placeholder (export CLAUDE_CODE_OAUTH_TOKEN="$(...)") is explicitly justified as the interactive step. It stops short of level 5 because a complete first run also requires reading references/runbook.md — minor gaps, matching 'mostly executable guidance with minor gaps'.

4 / 5

Workflow Clarity

Setup→run→teardown is clearly sequenced per runner with explicit validation semantics: 'Read integrity first', rows whose integrity falls short are 'not evidence about the protocol' and reprinted separately, and failures 'make run or report exit non-zero while preserving partial transcripts for inspection' — and protocol-prose 'refuses to run when the copy lost none'. It sits between anchors 4 and 5: the checkpoints are present, but what to do when integrity fails (the recovery action) is not stated in the body, so it does not reach level 5's 'feedback loops for error recovery'.

4 / 5

Progressive Disclosure

References are well-signaled and exactly one level deep, each with a stated purpose ('references/runbook.md — the workflow, where isolation lives, how to widen the matrix', 'references/grader-design.md — why the deterministic axis is behaviour rather than wording', 'scripts/harness.mjs — the runner and the deterministic graders'), and all referenced references/ and scripts/ files exist in the bundle. It is not level 5 because reference-grade detail — the per-target manual-column enumerations for inquire, grasp, and conduct in 'Reading results', and the worked-pair construction details in 'Cases' — is inlined in SKILL.md rather than split out.

4 / 5

Total

16

/

20

Passed

Description

70%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong, trigger-rich description for a niche skill: explicit when-guidance with six natural phrases, an explicit quality-assessment boundary, and third-person voice. It is weakened by an implicit 'what' — the capability list (drive runners, capture traces, grade transitions, report) never appears as concrete actions — and by one generic leading trigger.

Suggestions

State the 'what' as concrete actions before the 'when' clause, e.g. 'Drives Claude Code/Codex across a treatment matrix, captures the JSONL trace, grades deterministic transition predicates, and reports fulfillment rates.'

Qualify the generic 'run the eval' trigger (e.g. 'run the type-realization eval') to reduce overlap with unrelated eval-running skills.

DimensionReasoningScore

Specificity

The description names its niche domain ("runtime evidence that a protocol's formal transition contract is realized") and touches actions only through quoted phrases like "run the type-realization suite" and "measure protocol fulfillment", but never enumerates what the skill actually does (drive runners, capture JSONL traces, grade transitions). It fits the anchor 'names domain and 1-2 concrete actions, but not comprehensive' — not level 4, which requires several listed specific actions; not level 2, because the domain is far more precisely named than generic ('Processes PDF files').

3 / 5

Completeness

The 'when' is explicit and rich ("This skill should be used when the user asks to..."), and a 'what' is present ("wants runtime evidence that a protocol's formal transition contract is realized rather than an assessment of downstream artifact quality"), plus explicit invocation guidance ("Invoke explicitly with /realize and a skill argument"). The 'what' is folded into the when-clause rather than stated as its own capability list, so it matches level 4 ('both present; one could be more explicit') rather than level 5's clearly separated what and when.

4 / 5

Trigger Term Quality

Six quoted natural phrases ("run the eval", "test whether the protocol actually works at runtime", "check type realization", "measure protocol fulfillment", "run the type-realization suite", "does the gate actually stop") give good synonym coverage a user would plausibly say in this domain. It falls short of the level-5 'comprehensive coverage including synonyms' anchor because phrasings like "does the contract hold at runtime" or "realization check" are absent, but is clearly above level 3's 'missing common variations'.

4 / 5

Distinctiveness Conflict Risk

The niche is distinct and the clause "rather than an assessment of downstream artifact quality" carves an explicit boundary, and "at runtime" separates it from static checking. However the leading generic trigger "run the eval" could collide with other eval-running skills in the same ecosystem, matching 'mostly distinct; minor overlap risk with closely related skills' rather than level 5's 'minimal conflict risk'.

4 / 5

Total

15

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

allowed_tools_field

'allowed-tools' contains unusual tool name(s)

Warning

Total

15

/

16

Passed

Repository

jongwony/epistemic-protocols

Path

.claude/skills/realize/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.