CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

ai-risk-management

Apply the NIST AI Risk Management Framework (AI RMF 1.0) and adjacent guidance to AI / ML systems — model lifecycle governance, fairness and bias evaluation, robustness, transparency, accountability, third-party model risk, monitoring for drift, and AI incident response. Broader than prompt-injection (which is the security slice). Use when the user mentions 'AI risk,' 'AI governance,' 'NIST AI RMF,' 'AI compliance,' 'ML governance,' 'model risk management,' 'AI fairness,' 'AI bias,' 'algorithmic accountability,' 'AI Bill of Rights,' 'EU AI Act,' 'AI transparency,' 'model card,' 'AI red-team program,' 'AI safety,' 'responsible AI,' 'model drift,' 'concept drift,' 'AI monitoring,' 'AI incident,' or needs to assess or govern an AI / ML system.

Quality

86%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

71%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A well-structured, genuinely expert governance workflow with concrete tooling, decision tables, and a ready-to-use output template — the actionability and sequencing are strong for an instruction-only skill. Its weaknesses are mild over-explanation of known concepts, no error-recovery loops beyond the fairness-metric conflict note, and a monolithic ~250-line body whose dated regulatory layer should live in an updatable reference file.

Suggestions

Move the 'Regulatory layer' section (EU AI Act timeline table, US federal/state detail, standards list) into a references/regulatory-landscape.md file and keep a brief, undated summary plus a pointer in SKILL.md — this isolates the October 2026 time-sensitive content that will go stale and addresses progressive disclosure.

Trim definitional text Claude already knows (model cards / system cards, demographic parity, equalized odds, calibration) down to the decision guidance — keep 'which metric matters for which use case' and drop the textbook definitions.

Add explicit validation/feedback checkpoints in MEASURE and MANAGE, e.g., what to do when slice-level results contradict the aggregate eval, how to re-check a severity assignment before it enters the MANAGE plan, and one worked example of a finding → severity → treatment decision.

DimensionReasoningScore

Conciseness

The body is mostly efficient and adds domain-specific judgment Claude would not produce on its own (which fairness metric matters for hiring vs. lending, the MANAGE risk-treatment table, the dated regulatory timeline with '(verify)' flags). Minor over-explanation could be trimmed — e.g., definitional asides on concepts Claude already knows like "Model cards — Google's documentation pattern for ML models. Includes intended use..." and the demographic-parity/equalized-odds definitions — so it fits anchor 4 ('Efficient; minor instances of over-explanation that could be trimmed') rather than the lean anchor 5.

4 / 5

Actionability

The guidance is concrete and executable for an assessment skill: a five-step workflow, an inventory table with what to record per system, named tooling ("Fairlearn (Microsoft), AI Fairness 360 (IBM)... Foolbox, ART", "SHAP, LIME, integrated gradients"), a risk-to-treatment table, and a copy-paste-ready markdown output template. It stops short of anchor 5 ('fully executable... specific examples cover the common cases') because tooling is named without any usage examples or worked metric/severity examples — a minor gap, matching anchor 4.

4 / 5

Workflow Clarity

The Inventory → MAP → MEASURE → MANAGE → GOVERN sequence is clearly ordered with concrete sub-steps, and checkpoints exist in the form of '(verify)' flags on dated regulatory claims, the GOVERN checklist, and the References/evidence section of the output. It falls short of anchor 5's 'feedback loops for error recovery' — e.g., no guidance for iterating when MEASURE findings conflict with MAP risk-tiering (only the fairness-metric conflict is addressed) — so anchor 4 ('clear sequence with most checkpoints present; minor validation gaps') is the best fit.

4 / 5

Progressive Disclosure

The body is well-sectioned with headers and tables, but at ~250 lines it is monolithic: no bundle files exist (references/, scripts/, assets/ are absent) and everything is inline, including ~70 lines of dated regulatory timeline detail (EU AI Act dates, US state laws 'Status as of October 2026') that clearly belongs in a separately maintained reference file. This matches anchor 3 ('Some structure but could be better organized; ... content that should be separate is inline'); it is above anchor 2 because structure and navigation within the file are good, and below anchor 4 because time-sensitive regulatory detail that will go stale is inlined in the always-loaded file.

3 / 5

Total

15

/

20

Passed

Description

96%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: concrete framework anchor, comprehensive capability enumeration, explicit third-person 'what' plus a rich 'Use when' trigger list, and explicit disambiguation from the adjacent prompt-injection skill. The only weakness is a few overly broad trigger terms ('AI safety', 'responsible AI') that create minor conflict risk with adjacent safety/governance skills.

DimensionReasoningScore

Specificity

The description names a concrete framework ("Apply the NIST AI Risk Management Framework (AI RMF 1.0)") and enumerates eight specific capability areas — "model lifecycle governance, fairness and bias evaluation, robustness, transparency, accountability, third-party model risk, monitoring for drift, and AI incident response" — which is comprehensive coverage of the domain. This matches the anchor 'Lists multiple specific concrete actions; comprehensive coverage' rather than score 4, where coverage would have minor gaps.

5 / 5

Completeness

It explicitly answers both questions: what ("Apply the NIST AI Risk Management Framework (AI RMF 1.0) and adjacent guidance to AI / ML systems — ...") and when ("Use when the user mentions 'AI risk,' ... or needs to assess or govern an AI / ML system") with concrete trigger phrases. This is a direct match for anchor 5 ('Clearly and explicitly answers both what AND when with concrete trigger phrases'), not the score-4 anchor where the 'when' clause would be less explicit.

5 / 5

Trigger Term Quality

The trigger list is exhaustive and natural — "'AI risk,' 'AI governance,' 'NIST AI RMF,' 'AI compliance,' 'ML governance,' 'model risk management,' 'AI fairness,' 'AI bias,' ... 'model drift,' 'concept drift,' 'AI monitoring,' 'AI incident'" — including synonyms and variations users would actually say. It clearly matches anchor 5 ('Comprehensive coverage of natural terms including synonyms'); anchor 4 would require several missing natural terms, which is not the case.

5 / 5

Distinctiveness Conflict Risk

It carves a clear niche and explicitly disambiguates ("Broader than prompt-injection (which is the security slice)"), but broad trigger terms like "'AI safety,' 'responsible AI'" pull toward adjacent frontier-safety / responsible-AI territory that the skill body itself defers elsewhere. That is minor overlap risk with closely related skills (anchor 4) rather than the minimal conflict risk of anchor 5.

4 / 5

Total

19

/

20

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

allowed_tools_field

'allowed-tools' contains unusual tool name(s)

Warning

Total

15

/

16

Passed

Repository

briiirussell/cybersecurity-skills

Path

skills/ai-risk-management/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.