CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

determinize-skill

Use when auditing an existing agent skill (SKILL.md) to find where it leans on LLM judgment for work that could be deterministic, and to emit runnable promptfoo assertions that validate the deterministic parts. Covers two axes — offloading AI steps to code, and constraining AI output format. Triggers for "/determinize-skill PATH", "make this skill more deterministic", "audit a skill for determinism", "where can this skill be deterministic".

Quality

97%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

92%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A dense, highly actionable audit workflow with a fixed output schema, real runnable assertion templates, an explicit verify-before-report feedback loop, and a clean two-file reference bundle. The only weakness is mild token redundancy from restating the process and the Axis-B mandate in multiple forms.

Suggestions

Drop the mermaid flowchart (9 nodes that restate the linear prose process) or drop the duplicated prose — one representation of the sequence is enough.

Consolidate the Axis-B-is-mandatory message: it currently appears in the 'baseline failure' paragraph, the 'Generated assertions' section, and the Common Mistakes table; stating it once prominently would save tokens without losing the emphasis.

DimensionReasoningScore

Conciseness

Mostly lean — dense tables, no explanation of concepts Claude already knows, every section adds skill-specific content ("exit 0=confident, 10=abstain→AI", the abstain caller idiom). Minor trimmable redundancy: the mermaid flowchart restates the prose process, and Axis-B-mandatory is repeated in the "baseline failure" paragraph, the assertions section, and the Common Mistakes table.

4 / 5

Actionability

Fully executable guidance: a fixed output schema with a worked findings row and exact YAML block, a real runnable promptfoo template (verified present at references/promptfoo-template.yaml), bats test examples, and the concrete verification command "run `promptfoo eval -c determinism.promptfooconfig.yaml`" with the failure-recovery instruction.

5 / 5

Workflow Clarity

The process is explicitly sequenced (Parse → Read → Scan both axes → classify → generate assertions → emit fixed-schema report → ROI rank → write config → run config) with an explicit validation checkpoint and feedback loop: "If a test fails, fix the assertion (or the underlying Axis B fix) until all pass, then report ROI." The Common Mistakes table doubles as a checklist for failure modes.

5 / 5

Progressive Disclosure

The body is an overview that clearly signals one-level-deep references — "Full catalog (9 patterns + severity/effort rubric + bats template): [references/pattern-catalog.md]" and "The `determinism.promptfooconfig.yaml` template lives in [references/promptfoo-template.yaml]" — and both files exist in the bundle and contain exactly the promised content, with the seven most common patterns summarized inline for quick use.

5 / 5

Total

19

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is a model example: concrete capabilities, both axes of the work named, explicit "Use when" triggers with natural quoted phrasings, and a distinct niche. No changes needed.

DimensionReasoningScore

Specificity

Multiple concrete actions are named: "auditing an existing agent skill (SKILL.md) to find where it leans on LLM judgment", "emit runnable promptfoo assertions", "offloading AI steps to code", and "constraining AI output format" — comprehensive coverage of what the skill does and produces. Written in third-person imperative voice with no fluff or buzzwords.

5 / 5

Completeness

Both "what" (audit a skill to find non-deterministic steps and emit runnable promptfoo assertions, with the two covered axes named) and "when" (an explicit "Use when auditing an existing agent skill" clause plus a "Triggers for" list with concrete phrases) are clearly and explicitly answered.

5 / 5

Trigger Term Quality

Explicit natural trigger phrases are quoted verbatim: "/determinize-skill PATH", "make this skill more deterministic", "audit a skill for determinism", "where can this skill be deterministic" — covering the command form plus multiple phrasings a user would naturally say.

5 / 5

Distinctiveness Conflict Risk

A clear niche — determinism auditing of agent skills with promptfoo assertions — with distinct trigger terms unlikely to fire for other skills; nothing generic that would overlap with general refactoring or testing skills.

5 / 5

Total

20

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

AndreJorgeLopes/proof-of-skill

Path

skills/determinize-skill/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.