CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

testland/deepchecks-tests

Use for any question or task about checking ML data before or after training, including train-test leakage, data integrity problems, and models far better offline than in production. Runs Deepchecks data integrity, train-test validation and model evaluation suites on tabular, NLP or vision data, reruns them on production samples for drift and gates CI on passed conditions.

Quality

85%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

75%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, largely executable workflow that clearly sequences install → wrap → suite runs → per-check gating → CI, with a valuable anti-patterns table and explicit pass/fail gating in the right places. The main gaps are trimmable intro fluff, a CI step that depends on an unshown script, and no pass/fail or interpretation guidance for the integrity and train-test validation suites.

Suggestions

Cut the marketing-quote intro paragraph and the standalone "Per the [Deepchecks welcome] page." line; the When-to-use section already orients the reader (conciseness).

Either show a minimal ml/deepchecks_suite.py (composing the three suites with passed_conditions gating) or restate the CI step as running the Step 3-6 snippets directly, so the CI example is self-contained (actionability).

Add brief guidance on interpreting Steps 3-4 results — e.g., checking result.passed_conditions() or which conditions to gate on for the integrity and train-test validation suites — so every suite run has a defined pass/fail path (workflow_clarity).

DimensionReasoningScore

Conciseness

The body is dominated by tight, purposeful code blocks and catch-lists, but the marketing-quote intro ("a holistic open-source solution for all of your AI & ML validation needs") and the standalone "Per the [Deepchecks welcome] page." line are trimmable filler. Minor instances of over-explanation fit anchor 4 rather than the every-token-earns-its-place standard of anchor 5.

4 / 5

Actionability

Steps 2-6 give real, executable Deepchecks API code (Dataset wrapping, three suites, add_condition chaining), but the CI step runs "python ml/deepchecks_suite.py" — a script the skill never shows how to create — and vision/NLP paths are deferred entirely to external docs. Mostly executable with minor gaps fits anchor 4 rather than the copy-paste-ready completeness of anchor 5.

4 / 5

Workflow Clarity

Steps 1-7 are clearly sequenced and Steps 5-6 include explicit gating ("if not result.passed_conditions(): raise SystemExit"), but Steps 3-4 only save HTML reports with no pass/fail handling or interpretation guidance, and there is no fix-and-retry feedback loop. Clear sequence with most checkpoints present but minor validation gaps fits anchor 4 rather than anchor 5.

4 / 5

Progressive Disclosure

Sections are well organized (When to use, numbered steps, Anti-patterns, Limitations, References) and vision/NLP detail is delegated to a clearly signaled one-level-deep external doc. However, everything lives inline in a ~140-line file with no reference files for per-check API detail, which is good structure with minor organization gaps (anchor 4) rather than the appropriately split content of anchor 5.

4 / 5

Total

16

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description that explicitly states both what the skill does (runs three Deepchecks suites, reruns for drift, gates CI) and when to use it (pre/post-training ML data checks, leakage, integrity, offline-vs-production gaps) with mostly natural trigger terms. Its only weaknesses are a few missing common synonyms and slightly broad phrasing that creates minor overlap risk with adjacent ML-testing skills.

DimensionReasoningScore

Specificity

"Runs Deepchecks data integrity, train-test validation and model evaluation suites", "reruns them on production samples for drift", and "gates CI on passed conditions" list multiple concrete actions covering the skill's full range. It exceeds anchor 4 because the action coverage is comprehensive rather than having minor gaps.

5 / 5

Completeness

"Use for any question or task about checking ML data before or after training, including train-test leakage, data integrity problems..." explicitly answers when with concrete trigger phrases, while the suite-running and CI-gating clauses clearly answer what. Both are explicit and specific, matching anchor 5 rather than the merely-present 'when' of anchor 4.

5 / 5

Trigger Term Quality

Natural phrases like "train-test leakage", "data integrity", "drift", and "models far better offline than in production" match what users would say, but common synonyms such as "data validation", "ML testing", or "model monitoring" are missing. Good coverage with a few natural terms absent fits anchor 4 rather than the comprehensive synonym coverage of anchor 5 or the partial coverage of anchor 3.

4 / 5

Distinctiveness Conflict Risk

The ML-validation niche with Deepchecks-specific triggers (train-test leakage, offline-vs-production gap) is mostly distinct, but "model evaluation" and the broad "any question or task about checking ML data" leave minor overlap risk with closely related ML-testing skills. This fits anchor 4 better than the minimal-conflict clarity of anchor 5.

4 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

On this page