CtrlK
BlogDocsLog inGet started
Tessl Logo
PluginPublic

testland/evidently-monitoring

Use for any question or task about data drift or quality monitoring for a production ML model, including a fired drift alert and metrics such as precision that degrade slowly unnoticed: Evidently reports with tests for data drift, target drift and performance regression as a CI gate or scheduled job, and a playbook to pick rollback, retrain, quarantine or alert re-tuning.

Quality

87%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

81%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-built skill body: executable code for the common cases, a clearly sequenced seven-step workflow with genuine validation checkpoints and feedback loops, and a disciplined alert-triage playbook that gates destructive actions on evidence. The main improvements are trimming the marketing opener and duplicated gate code, and showing (not just describing) per-column drift-method configuration.

Suggestions

Replace the worked example's near-verbatim repeat of the Step 4 gate code with a one-line reference to it, and drop the '40+ million downloads / 100+ metrics' marketing opener (also repeated in Limitations) to tighten conciseness.

Add a short code snippet showing per-column drift method/threshold configuration (e.g., setting 'psi' with a custom threshold on the preset or data definition), since Step 4 and the triage playbook both depend on it but only name it in prose.

DimensionReasoningScore

Conciseness

The body is largely code-forward and efficient (steps, triage table, anti-patterns table all earn their tokens), with only minor trimmable material: the marketing opener ('over 40+ million downloads... 100+ evaluation metrics'), the repeated '100+ metrics' claim in Limitations, and the worked example duplicating the Step 4 gate code nearly verbatim. This fits the 4 anchor (efficient, minor instances that could be trimmed) rather than the 3 anchor's broader tightening need, and is not the fully lean 5.

4 / 5

Actionability

Core paths are copy-paste ready: 'pip install evidently', parquet loading, 'Report([DataDriftPreset()])', the CI gate reading '.dict()["tests"]' with 'raise SystemExit', and the scheduled job. Minor gaps keep it below 5: per-column drift-method/threshold tuning is described ('psi, wasserstein, ks...') but never shown in code, and Step 6 relies on undefined placeholders like 'load_production_window' and 'notify_oncall'.

4 / 5

Workflow Clarity

Steps 1-7 are explicitly sequenced with a summarizing 'How to use' list, validation is built in ('raise SystemExit' gate, 're-run the report before returning the model to live traffic'), and feedback loops appear both in the worked example (drift FAIL → widen threshold → re-run passes) and triage discipline ('Never retrain before ruling out hypotheses 1-3'). Risky actions (rollback, retrain, quarantine) are explicitly gated on cited report evidence, so the destructive-operation cap does not apply; this matches the 5 anchor's explicit validation, error recovery, and checklists (the triage signal table and ranked hypotheses).

5 / 5

Progressive Disclosure

With no bundle files, the single 270-line SKILL.md is well-sectioned (When to use, numbered steps, worked example, anti-patterns, limitations) and closes with a clearly signaled, one-level-deep References section of external doc links with inline definitions. It sits at the 4 anchor (good structure, minor organization gaps) rather than 5 because the ~60-line Step 7 triage playbook and the worked example could be split into reference files, and at 270 lines the under-50-line simple-skill exception does not apply; it is well above the 3 anchor's muddled structure.

4 / 5

Total

17

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description that explicitly covers both what the skill does and when to use it, with concrete trigger scenarios (fired drift alert, slowly degrading precision) and a comprehensive set of specific capabilities spanning reports, CI gating, scheduling, and incident triage. The only weaknesses are a few missing natural synonyms and minor overlap risk with neighboring MLOps skills.

DimensionReasoningScore

Specificity

The description lists multiple concrete capabilities — 'tests for data drift, target drift and performance regression as a CI gate or scheduled job' plus a 'playbook to pick rollback, retrain, quarantine or alert re-tuning' — comprehensively covering detection, gating, scheduling, and response for the domain. It exceeds the 4 anchor ('several specific actions; minor gaps') because no meaningful capability gap remains.

5 / 5

Completeness

It explicitly answers both questions: 'when' via 'Use for any question or task about data drift or quality monitoring for a production ML model, including a fired drift alert and metrics such as precision that degrade slowly unnoticed', and 'what' via the Evidently reports/tests/playbook clause. This matches the 5 anchor (explicit what AND when with concrete trigger phrases); the 4 anchor's weaker 'when could be more explicit' does not apply.

5 / 5

Trigger Term Quality

Good natural-keyword coverage: 'data drift', 'quality monitoring', 'production ML model', 'drift alert', 'precision', and the library name 'Evidently' are phrases users would naturally say. It falls short of the 5 anchor's comprehensive synonym/extension coverage (e.g., 'model monitoring', 'concept drift', 'retraining' are absent) but is well above the 3 anchor's partial coverage.

4 / 5

Distinctiveness Conflict Risk

A clear niche — Evidently-based production drift monitoring with alert triage — with distinct triggers, but 'quality monitoring for a production ML model' leaves minor overlap risk with adjacent MLOps monitoring or model-risk skills. Mostly distinct per the 4 anchor; not the minimal-conflict clarity of the 5 anchor.

4 / 5

Total

18

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

On this page