prediction-monitor

Prediction Monitor - Auto-activating skill for ML Deployment. Triggers on: prediction monitor, prediction monitor Part of the ML Deployment skill category.

1.03x

Quality

Does it follow best practices?

Impact

93%

1.03x

Average score across 3 eval scenarios

Securityby

Passed

No known issues

Optimize this skill with Tessl

npx tessl skill review --optimize ./planned-skills/generated/08-ml-deployment/prediction-monitor/SKILL.md

Evaluation results

89%

Retail Forecasting Model Drift Detector

Production prediction drift monitoring

Criteria

Without context

With context

Config file present

100%

Config loaded at runtime

100%

Output validation present

20%

Per-category statistics

100%

Overall drift assessment

100%

Structured JSON report

100%

Error handling present

62%

Drift metric computed

100%

Logging or status output

100%

Modular code structure

100%

No large files left

100%

Without context: $0.4365 · 1m 38s · 23 turns · 23 in / 6,559 out tokens

With context: $0.5992 · 2m 8s · 31 turns · 64 in / 7,552 out tokens

95%

-1%

Inference Service Monitoring Pipeline Setup

Structured MLOps monitoring pipeline

Criteria

Without context

With context

Serving metrics component

100%

Prediction metrics component

100%

Pipeline/data metrics component

100%

Modular file organization

100%

Entry point present

100%

Configuration file

100%

Architecture documentation

100%

Step-by-step workflow described

100%

Input validation present

77%

66%

Production patterns used

80%

No large files left

100%

Without context: $0.9912 · 4m 6s · 34 turns · 34 in / 17,209 out tokens

With context: $1.1906 · 4m 12s · 47 turns · 130 in / 17,498 out tokens

97%

Credit Risk Model Prediction Validator

Prediction output validation and alerting

Criteria

Without context

With context

Validation rules file

100%

Rules loaded at runtime

100%

Score range validation

100%

Label consistency check

100%

Completeness check

100%

Alerts written to file

100%

Alert detail includes reason

100%

Validation summary output

100%

Error handling present

100%

Structured alert schema

100%

70%

No large files left

100%

Without context: $0.6771 · 2m 37s · 31 turns · 186 in / 9,369 out tokens

With context: $0.4729 · 1m 41s · 29 turns · 27 in / 6,499 out tokens

Repository: jeremylongshore/claude-code-plugins-plus-skills
Commit: f17dd51

Evaluated: 17 days ago
Agent: Claude Code
Model: Claude Sonnet 4.6

Table of Contents

Retail Forecasting Model Drift Detector Inference Service Monitoring Pipeline Setup Credit Risk Model Prediction Validator

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.