CtrlK
BlogDocsLog inGet started
Tessl Logo

validating-ai-ethics-and-fairness

Validate AI/ML models and datasets for bias, fairness, and ethical concerns. Use when auditing AI systems for ethical compliance, fairness assessment, or bias detection. Trigger with phrases like "evaluate model fairness", "check for bias", or "validate AI ethics".

59

Quality

Does it follow best practices?

Impact

No eval scenarios have been run

SecuritybySnyk

Passed

No known issues

SKILL.md
Quality
Evals
Security

Quality

Content

50%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is well-structured with specific metrics, thresholds, and a useful error-handling table, but it stays at a procedural-descriptive level: no executable code, no inline validation checkpoints, and bundled resources are not navigated to.

Suggestions

Add copy-paste-ready code or command examples showing how to run the bundled scripts (e.g. `python scripts/validate_model.py --model model.pkl --data data.csv --attr race,gender`) so the guidance is fully executable.

Embed validation checkpoints in the workflow (e.g. after step 4, 'verify each group has >= 30 samples before classifying severity; if not, apply the Insufficient group sample size handling') rather than relegating all checks to a separate table.

Link the bundled files from the body — point to scripts/generate_report.py and assets/report_template.md in the Output section, and reference validate_dataset.py in step 1 — so progressive disclosure is actually wired up.

DimensionReasoningScore

Conciseness

The body is mostly efficient and assumes Claude's competence (it names metrics like demographic parity and TPR/FPR without explaining them), but the Overview restates the description and the three Examples are narrative-heavy, so it could be tightened.

2 / 3

Actionability

It gives concrete specifics (four-fifths 0.80 threshold, severity bands, proxy r > 0.3, named library calls like ExponentiatedGradient) but contains no executable code blocks and never shows how to invoke the bundled scripts, leaving guidance incomplete.

2 / 3

Workflow Clarity

A clear 10-step sequence is present and an Error Handling table supplies recovery guidance, but validation checkpoints are not embedded inline in the workflow ('validate then only proceed'), which the rubric requires for a score of 3 on batch/analysis operations.

2 / 3

Progressive Disclosure

Sections are well organized, but the bundled scripts (validate_model.py, validate_dataset.py, generate_report.py) and assets (report_template.md, example files) are never referenced or linked from the body, leaving those reference files orphaned and poorly signaled.

2 / 3

Total

8

/

12

Passed

Description

90%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: third-person, with clear what/when structure and natural trigger phrases. Its only weakness is a single broad action verb rather than an enumerated list of concrete capabilities.

DimensionReasoningScore

Specificity

It names the domain ('AI/ML models and datasets') and related actions ('auditing... fairness assessment, or bias detection') but centers on a single verb ('Validate') with multiple objects rather than listing several distinct concrete actions, so it falls short of the comprehensive multi-action anchor.

2 / 3

Completeness

It clearly states what the skill does ('Validate AI/ML models and datasets for bias, fairness, and ethical concerns') and when to use it ('Use when auditing AI systems...'), satisfying both halves with an explicit trigger clause.

3 / 3

Trigger Term Quality

Natural phrases a user would actually say are explicitly provided ('check for bias', 'evaluate model fairness', 'validate AI ethics'), giving good coverage of likely trigger language.

3 / 3

Distinctiveness Conflict Risk

The bias/fairness/ethics validation niche is specific with distinct triggers, making it unlikely to fire for unrelated skills; voice is correctly third person with no first/second-person phrasing.

3 / 3

Total

11

/

12

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

allowed_tools_field

'allowed-tools' contains unusual tool name(s)

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

14

/

16

Passed

Repository
jeremylongshore/claude-code-plugins-plus-skills
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.