CtrlK
BlogDocsLog inGet started
Tessl Logo

testland/alibi-explainability

Generates model explanations with Alibi Explain - Anchors, Integrated Gradients, Kernel/Tree SHAP, ALE, Counterfactual Instances. Wires explainer.fit + explainer.explain into model-evaluation pipelines so that every flagged prediction ships with a "why" record auditors can reason about. Use when a model decision must be explainable to an auditor, regulator, or affected user, or when a support team cannot answer why a specific prediction was made.

75

Quality

94%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

Overview
Quality
Evals
Security
Files

Quality

Content

87%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The content is concise, actionable, and well-structured with executable examples and a clear explainer-selection table. Its main gap is the absence of explicit validation/verification checkpoints in the explain-and-log workflow, which is material for batch audit-record generation.

Suggestions

Add an explicit validation checkpoint in Step 6 before writing the audit record — e.g., assert the explanation has non-empty data/meta and that the target file does not already exist, with a re-explain/retry path on failure.

Define or note the setup variables used in the code examples (FEATURE_NAMES, CATEGORICAL_INDEX, classifier, X_train/X_test) so the snippets are fully copy-paste runnable, or point to where they are constructed.

For the batch case ("every flagged prediction ships with a record"), add a short feedback-loop note: log failures separately and verify the written JSON parses before considering the record committed.

DimensionReasoningScore

Conciseness

The body is lean — mostly tables, numbered steps, and executable code — and does not re-explain concepts Claude already knows; even the prose intros ("Anchors return a minimal feature subset...") earn their place by clarifying the method's output contract.

3 / 3

Actionability

It provides real, executable Python for AnchorTabular, CounterfactualProto, and an explain_and_log helper, plus a pip install command and the fit/explain interface pattern, matching the copy-paste-ready anchor.

3 / 3

Workflow Clarity

Steps 1–7 are clearly sequenced, but the workflow lacks explicit validation/verification checkpoints (no validate→fix→retry loop), which the rubric caps at 2 for batch/audit-style operations that persist records for every prediction.

2 / 3

Progressive Disclosure

The file is well-organized into clearly signaled sections and points repeatedly to a single one-level-deep external reference ([Alibi Explain docs]); there are no nested multi-level references and no bundle files requiring further splitting.

3 / 3

Total

11

/

12

Passed

Description

100%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is specific, trigger-rich, and complete, naming concrete explainer families and an explicit Use-when clause tied to auditor/regulator scenarios. It is clearly distinguishable and unlikely to fire for unrelated skills.

DimensionReasoningScore

Specificity

Lists multiple concrete capabilities and named methods ("Anchors, Integrated Gradients, Kernel/Tree SHAP, ALE, Counterfactual Instances") plus the concrete wiring action ("Wires explainer.fit + explainer.explain into model-evaluation pipelines"), matching the multiple-specific-actions anchor.

3 / 3

Completeness

It explicitly answers both what ("Generates model explanations...") and when ("Use when a model decision must be explainable...") with an explicit trigger clause, matching the top anchor.

3 / 3

Trigger Term Quality

The "Use when..." clause surfaces natural terms a user would say — "explainable to an auditor, regulator, or affected user", "cannot answer why a specific prediction was made" — giving good coverage of natural phrasing rather than jargon.

3 / 3

Distinctiveness Conflict Risk

It carves a clear niche (Alibi Explain model explanations for audit/regulatory contexts) and even distinguishes itself from the sister alibi-detect package, making conflicts unlikely.

3 / 3

Total

12

/

12

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_version

'metadata.version' is missing

Warning

Total

15

/

16

Passed

Reviewed

Table of Contents