CtrlK
BlogDocsLog inGet started
Tessl Logo

testland/evidently-monitoring

Use Evidently OSS (100+ evaluation metrics, declarative testing API) to detect data drift, target drift, and model-performance regression, wired into CI as a gate (a Report run with include_tests) and into production monitoring as a continuous check; reports as HTML + JSON for both human review and pipeline assertions. Includes a drift-alert triage playbook: classify the fired alert's signal, rank root-cause hypotheses (upstream schema change, pipeline bug, training-serving skew, seasonality, genuine population shift), and pick rollback, retrain, quarantine, or alert re-tuning. Use when you need a drift or quality gate, a scheduled monitoring job, or a structured triage of a fired drift alert, for a tabular ML model. Built on the Evidently API specifically: for DeepChecks-based validation suites use deepchecks-tests instead.

68

Quality

85%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

73%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is highly actionable with a clear, validated workflow and strong triage guidance, but it carries noticeable redundancy from triple-coverage of the CI gate (overview, Step 4, worked example) plus marketing fluff, and inlines everything rather than splitting the large triage playbook into a reference file.

Suggestions

Remove the duplicated CI-gate code: keep it once in Step 4 and have the 'How to use' overview and Worked example reference Step 4 instead of re-printing the block, to tighten conciseness.

Drop the '40+ million downloads' marketing quote from the opening; replace with the one fact Claude needs (Evidently provides 100+ metrics and a declarative testing API) if any framing is needed.

Consider moving the Step 7 triage playbook into a references/TRIAGE.md (or similar) and summarizing it in the body, so the large procedural content is split one level deep and progressive_disclosure can reach 5.

DimensionReasoningScore

Conciseness

Mostly efficient with lean code, but the 'How to use' overview re-states each step that is then re-expanded in Steps 1-7 and re-shown in the Worked example (the CI gate code appears three times), and the opening '40+ million downloads' quote is padding, fitting the 'mostly efficient but could be tightened' anchor rather than 4.

3 / 5

Actionability

Provides concrete, mostly copy-paste-ready code across install, drift report, CI gate, presets, and scheduling, with the triage section giving specific ranked actions; minor gaps are stub helpers (load_production_window, notify_oncall) and the .dict()['tests'] shape being asserted rather than demonstrated, fitting the 'mostly executable with minor gaps' anchor.

4 / 5

Workflow Clarity

Clear 7-step sequence with explicit validation checkpoints (gate reads test status and raises SystemExit on FAIL/ERROR), a worked-example fail→fix→re-run feedback loop, and a triage discipline checklist with hard rules ('Never retrain before ruling out hypotheses 1-3'), matching the anchor for explicit validation steps and feedback loops.

5 / 5

Progressive Disclosure

Well-organized into clearly headed sections with one-level-deep, clearly signaled external-doc references defined at the bottom; the gap keeping it from 5 is that no content is split across files (the substantial triage playbook and anti-patterns table are inlined) and no bundle files exist to appropriately separate.

4 / 5

Total

16

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is specific, complete, and well-disambiguated, with explicit what/when guidance and concrete trigger phrases. Its only gap is trigger-term breadth — a few common synonyms and file extensions are missing from an otherwise strong keyword set.

Suggestions

Add common synonyms and natural phrasings to the trigger clause, e.g. 'concept drift', 'model monitoring', 'model degradation', and '.parquet' inputs, to push trigger_term_quality toward comprehensive coverage.

Consider trimming the library-marketing detail ('40+ million downloads') which does not help activation, keeping the description focused on triggers and capabilities.

DimensionReasoningScore

Specificity

Lists multiple concrete actions — 'detect data drift, target drift, and model-performance regression', 'wired into CI as a gate (a Report run with include_tests)', 'reports as HTML + JSON', 'rank root-cause hypotheses', 'pick rollback, retrain, quarantine, or alert re-tuning' — giving comprehensive coverage of the skill's surface, matching the anchor for listing multiple specific concrete actions.

5 / 5

Completeness

Explicitly answers both what (detect/target/performance drift, CI gate, prod monitoring, triage playbook) and when ('Use when you need a drift or quality gate, a scheduled monitoring job, or a structured triage of a fired drift alert, for a tabular ML model') with concrete trigger phrases, matching the 5 anchor.

5 / 5

Trigger Term Quality

Strong natural trigger phrases a user would say ('drift or quality gate', 'scheduled monitoring job', 'structured triage of a fired drift alert', 'tabular ML model') but missing common synonyms like 'concept drift'/'model monitoring' and file extensions, so it fits good-but-not-comprehensive coverage rather than the 5 anchor.

4 / 5

Distinctiveness Conflict Risk

Carves a clear Evidently-specific niche and explicitly disambiguates the closest sibling ('for DeepChecks-based validation suites use deepchecks-tests instead'), giving minimal conflict risk per the 5 anchor.

5 / 5

Total

19

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

Total

15

/

16

Passed

Reviewed

Table of Contents