CtrlK
BlogDocsLog inGet started
Tessl Logo

transformer-lens-interpretability

Provides guidance for mechanistic interpretability research using TransformerLens to inspect and manipulate transformer internals via HookPoints and activation caching. Use when reverse-engineering model algorithms, studying attention patterns, or performing activation patching experiments.

74

Quality

92%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Low

Low-risk findings worth noting

SKILL.md
Quality
Evals
Security

Quality

Content

85%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is highly actionable with executable code, well-sequenced workflows, and clean progressive disclosure to a real references folder. Its main weakness is conciseness: introductory exposition and version notes add tokens without adding skill-specific value.

Suggestions

Trim the introductory paragraph ('de facto standard library...', author/maintainer attribution, and GitHub star count) — Claude does not need library provenance to apply the skill.

Move or drop the 'Version Notes' section; specific version numbers and alpha-status notes are time-sensitive and add noise without actionable guidance, unless placed in a clearly marked deprecated/changes section.

Consider relocating the full 'ActivationCache Keys' and 'Supported Models' tables to references/api.md to keep SKILL.md leaner while keeping a brief inline pointer.

DimensionReasoningScore

Conciseness

Mostly efficient with executable, well-targeted code, but padded with exposition Claude likely already knows ('de facto standard library... Created by Neel Nanda and maintained by Bryce Meyer', GitHub star counts, and version notes) that does not earn its place.

2 / 3

Actionability

Provides fully executable, copy-paste-ready code for caching, activation patching, head contribution decomposition, and induction-head detection with specific API calls and tensor shapes.

3 / 3

Workflow Clarity

Each workflow is clearly sequenced with numbered steps and an explicit checklist; these are observational analysis tasks rather than destructive/batch operations, so the absence of validation feedback loops does not cap the score.

3 / 3

Progressive Disclosure

SKILL.md is an organized overview pointing to a clearly signaled, one-level-deep references table (README.md, api.md, tutorials.md), all of which are real files with content appropriately split from the main body.

3 / 3

Total

11

/

12

Passed

Description

100%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is specific, complete, and distinct: it names concrete capabilities, includes an explicit 'Use when' trigger, and occupies a clear niche. It is a strong, well-constructed skill description.

DimensionReasoningScore

Specificity

Lists multiple concrete actions ('inspect and manipulate transformer internals via HookPoints and activation caching', 'reverse-engineering model algorithms', 'studying attention patterns', 'activation patching experiments').

3 / 3

Completeness

Clearly answers what ('inspect and manipulate transformer internals via HookPoints and activation caching') and when with an explicit 'Use when...' trigger clause.

3 / 3

Trigger Term Quality

Uses natural domain terms a user would say when needing the skill ('reverse-engineering model algorithms', 'attention patterns', 'activation patching') with good coverage of the niche's vocabulary.

3 / 3

Distinctiveness Conflict Risk

Occupies a clear niche (mechanistic interpretability with TransformerLens) with distinct, specialized triggers unlikely to overlap with other skills.

3 / 3

Total

12

/

12

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository
synthetic-sciences/openscience
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.