CtrlK
BlogDocsLog inGet started
Tessl Logo

testland/model-risk-evidence-matrix

Assigns a machine learning model to a low, medium, or high risk tier from what its predictions decide about people, then derives the fairness and explainability evidence that tier must produce: group metrics per declared sensitive feature, intersectional breakdowns with per-cell counts, vulnerability scan categories, a drift monitoring plan, and per-prediction explanation logs. Supplies conventional demographic parity difference bands, a per-vulnerability-category blocking table, and evidence rules that mark a bundle incomplete or self-contradicting. Use when a model release candidate is up for promotion and someone must decide which fairness artifacts are mandatory rather than nice to have, or when a model card declares a risk tier and the attached evidence bundle has to be checked against what that tier demands.

80

Quality

100%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

100%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A dense but lean decision-matrix skill: it quotes and links authoritative sources rather than re-teaching concepts, gives executable bands/rules/waiver schema, sequences an eight-step workflow with built-in validation, and pushes only the worked walk-through to a single real reference file. Token-dense because the domain is, yet every token earns its place.

DimensionReasoningScore

Conciseness

Assumes Claude's competence throughout - it states the Fairlearn/EEOC/GDPR conditions by quoting and linking the source rather than re-explaining what fairness or a PDF-style concept is, and each section adds only what Claude would not already know (the matrix, the bands, the rules).

3 / 3

Actionability

Provides copy-paste-ready, executable specifics: the verdict-band table (DPD <= 0.05 -> PASS, etc.), the four-field waiver schema ("Reason:, Approved-by:, Re-review-date:, expires:"), the six evidence rules R1-R6 with explicit triggers, and a worked example emitting a concrete coverage report.

3 / 3

Workflow Clarity

An explicit eight-step sequence (assign tier -> read required evidence -> name metric -> accept conflict -> apply bands -> require intersectional counts -> triage scan -> check rules) with validation checkpoints built into the rules, e.g. R3 (BLOCK band names a missing artifact) and R4 (a monitoring claim without a reference dataset is contradicted).

3 / 3

Progressive Disclosure

SKILL.md is a self-contained overview that signals exactly one one-level-deep reference - [references/worked-example.md](references/worked-example.md) - which exists as a real bundle file, keeping the dense end-to-end walk-through out of the main body while the matrix and rules stay inline.

3 / 3

Total

12

/

12

Passed

Description

100%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong third-person description that names concrete artifacts, supplies an explicit Use-when trigger clause, and carves out a distinctive niche at the promotion/evidence-check decision point. It is long but every clause earns its place; no fluff or over-claims.

DimensionReasoningScore

Specificity

Lists multiple concrete actions - "Assigns a machine learning model to a low, medium, or high risk tier", "derives the fairness and explainability evidence", "group metrics per declared sensitive feature, intersectional breakdowns with per-cell counts, vulnerability scan categories, a drift monitoring plan, and per-prediction explanation logs" - each naming a distinct artifact rather than vague capability.

3 / 3

Completeness

Answers both halves explicitly: the what ("Assigns a machine learning model to a... risk tier... then derives the fairness and explainability evidence that tier must produce") and the when via an explicit "Use when a model release candidate is up for promotion... or when a model card declares a risk tier and the attached evidence bundle has to be checked".

3 / 3

Trigger Term Quality

Covers natural terms a reviewer would say - "model release candidate is up for promotion", "model card declares a risk tier", "evidence bundle", "fairness artifacts" - matching how practitioners phrase the request.

3 / 3

Distinctiveness Conflict Risk

Occupies a clear niche (risk-tier-to-evidence-requirement mapping) with triggers tied to release promotion and model-card tier declarations, unlikely to fire for general fairness or model-training skills.

3 / 3

Total

12

/

12

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation16 / 16 Passed

Validation for skill structure

No warnings or errors.

Reviewed

Table of Contents