CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

testland/giskard-tests

Use for any question or task about testing a trained tabular or NLP model before it ships, including robustness to small input changes, data leakage and fairness, or a pre-merge check after a feature or hyperparameter change. Runs Giskard scan and its test catalog for performance, robustness, fairness, data leakage and ethical issues, and emits suites that pass or fail in CI.

Quality

85%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

75%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, action-oriented skill body with executable code at every step, a clear step sequence, and effective anti-pattern and limitations sections. It consistently lands just below excellent: minor redundancy (repeated scan categories and quickstart citations), placeholder-dependent code, and no explicit error-recovery loop keep each dimension at 4 rather than 5.

DimensionReasoningScore

Conciseness

The body is code-heavy and assumes Claude's competence (no explanations of ML or library basics), but contains trimmable redundancy: the scan-category list ("performance bias, unrobustness, data leakage, stochasticity, underconfidence, ethical issues") is stated in both the intro and Step 4, and "Per the [Giskard tabular quickstart]" appears four times. This matches the score-4 anchor (efficient with minor instances that could be trimmed) rather than score 5's every-token-earns-its-place.

4 / 5

Actionability

Concrete, mostly executable guidance across all seven steps — install command, Dataset/Model wrapping, scan call, suite generation with a pass/fail gate, catalog tests with thresholds and a slicing example, and CI YAML. Not score 5 because the code relies on undefined placeholders (raw_data, preprocessing_function, classifier, FEATURE_NAMES), so it is not copy-paste runnable as-is.

4 / 5

Workflow Clarity

Steps 1-7 are clearly sequenced (install → wrap dataset → wrap model → scan → generate suite → add tests → CI) with pass/fail checkpoints ("if not suite_results.passed: raise SystemExit" and the CI SystemExit note). Not score 5 because there is no explicit error-recovery feedback loop (what to do when the suite fails beyond the anti-patterns table); the destructive/batch cap does not apply since the workflow is non-destructive.

4 / 5

Progressive Disclosure

Well-organized single-file structure with clear sections (When to use, Steps 1-7, Anti-patterns, Limitations, References) and a clearly signaled one-level-deep external reference; no bundle files exist to score against. Not score 5 because at ~150 lines the body carries content (full test-catalog pointers, CI config) that could be split into a reference file for a leaner overview.

4 / 5

Total

16

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description that explicitly answers both what the skill does and when to use it, with concrete capability enumeration and mostly natural trigger terms. Its main weaknesses are a few missing synonym triggers (e.g., "bias", "model audit") and a slightly broad "any question or task about testing" framing that creates minor overlap risk with general testing skills.

DimensionReasoningScore

Specificity

The description lists multiple concrete actions — "Runs Giskard scan", runs "its test catalog for performance, robustness, fairness, data leakage and ethical issues", and "emits suites that pass or fail in CI" — comprehensively covering the skill's core capabilities. It fits the score-5 anchor (multiple specific concrete actions, comprehensive coverage) better than score 4, which would require notable coverage gaps.

5 / 5

Completeness

Both what and when are explicit: the when-clause "Use for any question or task about testing a trained tabular or NLP model before it ships, including... a pre-merge check after a feature or hyperparameter change" gives concrete triggers, and the what-clause specifies scan, test catalog, and CI suite emission. This matches the score-5 anchor with concrete trigger phrases, so no cap applies.

5 / 5

Trigger Term Quality

Good natural keyword coverage: "testing a trained tabular or NLP model before it ships", "robustness to small input changes", "data leakage and fairness", "pre-merge check", "CI" — phrases users would plausibly say. Not score 5 because common synonyms and variations like "bias", "model audit", or "model validation/QA" are missing.

4 / 5

Distinctiveness Conflict Risk

The Giskard-specific model-vulnerability scanning niche is mostly distinct with clear tool-specific triggers. Not score 5 because "any question or task about testing a trained... model" is broad enough to overlap with general unit-testing or model-evaluation skills.

4 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

On this page