CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

testland/promptfoo-evaluation

Use for any question or task about Promptfoo or adding quick regression checks for prompts or RAG pipelines in CI, including turning written requirements into assertions: promptfooconfig.yaml providers, prompts and tests, deterministic, semantic, model-graded, latency and cost assertions, promptfoo eval and view, and CI gating.

Quality

90%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

82%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, highly actionable single-file skill that earns its length with tool-specific tables and executable examples. The main improvement opportunities are trimming citation overhead and adding explicit guidance for handling eval failures.

DimensionReasoningScore

Conciseness

The body is dense with tables, code, and tool-specific facts Claude would not know, with no padding explaining basic concepts. Minor trimmable material remains, such as repeated 'per [pf-config]' citation phrases and the full GitHub Action input list, keeping it just short of fully lean.

4 / 5

Actionability

Every step provides copy-paste-ready material: install commands ('npm install -g promptfoo'), init/eval/view commands, complete YAML config snippets, assertion examples with concrete thresholds, and a real GitHub Actions workflow block covering the common CI case.

5 / 5

Workflow Clarity

Steps 1-8 form a clear, logical sequence from install through CI gating, with 'promptfoo view' as an inspection checkpoint and an anti-patterns table covering failure modes. It lacks an explicit fail-then-fix feedback loop for interpreting and recovering from eval failures, so it stops short of a 5.

4 / 5

Progressive Disclosure

With no bundle files, all content lives in SKILL.md, but it is well-organized under clear section headers with a consolidated References list and easy navigation. The sizable inline assertion catalog is material that could arguably move to a references file, preventing a 5.

4 / 5

Total

17

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description that explicitly covers both what the skill does and when to use it, with concrete tool-specific triggers. The only weakness is slightly incomplete synonym coverage for natural user phrasing.

DimensionReasoningScore

Specificity

The description lists multiple concrete capabilities — 'turning written requirements into assertions', 'promptfooconfig.yaml providers, prompts and tests', 'deterministic, semantic, model-graded, latency and cost assertions', 'promptfoo eval and view', and 'CI gating' — giving comprehensive coverage of the skill's functionality with no significant gaps.

5 / 5

Completeness

Both parts are explicit: 'Use for any question or task about Promptfoo or adding quick regression checks for prompts or RAG pipelines in CI' answers when, and the colon-clause enumerating config keys, assertion types, commands, and CI gating answers what with concrete trigger phrases.

5 / 5

Trigger Term Quality

It includes natural terms users would say such as 'Promptfoo', 'regression checks', 'prompts', 'RAG pipelines', 'CI', and the concrete filename 'promptfooconfig.yaml', but misses common synonyms like 'evaluation', 'LLM testing', or 'benchmarking' that a user might naturally use.

4 / 5

Distinctiveness Conflict Risk

The description is anchored to a single named tool ('Promptfoo') and its specific config file ('promptfooconfig.yaml'), creating a clear niche with minimal conflict risk even against sister evaluation-framework skills.

5 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

On this page