CtrlK
BlogDocsLog inGet started
Tessl Logo

testland/deepchecks-tests

Run Deepchecks suites (data integrity, train-test validation, model evaluation) on tabular / NLP / vision data + models. Pass `result.passed_conditions()` to CI to gate on regressions; the same checks run during research, CI, and production monitoring per the Deepchecks lifecycle posture. Use before training to catch train-test leakage and data-integrity defects in a tabular, NLP, or vision dataset, and to re-run the same suite on production samples to detect drift.

72

Quality

90%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

82%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A strong, code-first skill: every step is executable, validation gating is demonstrated via passed_conditions(), and the anti-patterns table adds real operational judgment. The main gaps are the un-gated Steps 3-4, a small amount of marketing/redundant prose, and NLP/vision coverage deferred entirely to external docs.

Suggestions

Add the same passed_conditions() gating used in Step 5 to the data_integrity (Step 3) and train_test_validation (Step 4) suites so every suite run has an explicit pass/fail checkpoint.

Trim the marketing quote in the intro ("a holistic open-source solution...") and drop the redundant "Per the [Deepchecks welcome] page." after pip install; the References section already carries the link.

Bundle short vision/NLP Dataset-wrapping snippets into a references/ file (linked one level deep) so the NLP/vision coverage claimed in the description is actionable without leaving the skill.

DimensionReasoningScore

Conciseness

The body is code-dominated and mostly lean ("`cat_features` matters for distribution checks", the per-step "Catches:" lists), but the intro pads with the marketing quote "a holistic open-source solution for all of your AI & ML validation needs" and Step 1 ends with a redundant "Per the [Deepchecks welcome] page." that the References section already covers. This is efficient with minor trims possible, matching anchor 4 rather than anchor 5's every-token-earns-its-place.

4 / 5

Actionability

Every step is fully executable copy-paste code: "pip install deepchecks", Dataset wrapping with label/cat_features, "result = integrity.run(train_ds)", "if not result.passed_conditions(): raise SystemExit(...)", "FeatureDrift().add_condition_drift_score_less_than(...)", and a concrete CI YAML snippet. It matches anchor 5: specific examples cover the common cases with no pseudocode or missing details.

5 / 5

Workflow Clarity

Steps 1-7 are clearly sequenced with explicit validation checkpoints in Steps 5-6 ("if not result.passed_conditions():" plus "print(result.value)" before exiting for diagnosis). However Steps 3-4 run and save suites with no pass/fail gating shown, and there is no explicit fix-and-retry guidance, so it sits at anchor 4 (most checkpoints present, minor gaps) rather than anchor 5.

4 / 5

Progressive Disclosure

A single well-organized file with clearly signaled one-level-deep references ("[Deepchecks welcome] - overview, install, suite/check architecture, per-data-type quickstart links"); no bundle files exist to verify. But the skill claims tabular/NLP/vision coverage while the body only demonstrates tabular and defers Vision/NLP entirely to external docs ("The Vision and NLP APIs differ - see the [Deepchecks welcome] section"), a minor organization gap that keeps it at anchor 4 rather than 5.

4 / 5

Total

17

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: third-person, concrete, lifecycle-complete, with an explicit 'Use before training... and to re-run...' trigger clause covering both research and production contexts. The only weakness is trigger-term coverage that misses a few natural user synonyms and includes one piece of vendor jargon ("lifecycle posture").

DimensionReasoningScore

Specificity

It lists multiple concrete API-level actions spanning the full lifecycle: "Run Deepchecks suites (data integrity, train-test validation, model evaluation)", "Pass `result.passed_conditions()` to CI to gate on regressions", and "re-run the same suite on production samples to detect drift". This matches anchor 5 (comprehensive coverage of specific concrete actions); it exceeds anchor 4 because there are no meaningful coverage gaps, and the voice is correctly third person ("Run", "Pass").

5 / 5

Completeness

It explicitly answers both questions: the what ("Run Deepchecks suites (data integrity, train-test validation, model evaluation)... Pass `result.passed_conditions()` to CI") and the when with concrete trigger phrases ("Use before training to catch train-test leakage and data-integrity defects in a tabular, NLP, or vision dataset, and to re-run the same suite on production samples to detect drift"). This is a direct match for anchor 5.

5 / 5

Trigger Term Quality

Good natural keyword coverage: "train-test leakage", "data-integrity defects", "model evaluation", "drift", "regressions", "production samples". It falls short of anchor 5 because common user phrasings and synonyms are missing (e.g., "validate my data", "data quality", "ML testing") and "per the Deepchecks lifecycle posture" is vendor jargon a user would never say; it is above anchor 3 because most terms a user would naturally utter when needing this skill are present.

4 / 5

Distinctiveness Conflict Risk

The named tool (Deepchecks) plus distinct trigger domain (train-test leakage, drift detection, suite-based ML validation) gives it a clear niche with minimal conflict risk against generic testing or data-processing skills. It matches anchor 5; it cannot be anchor 4's "minor overlap risk" because the named-tool triggers are essentially unambiguous.

5 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

Table of Contents