CtrlK
BlogDocsLog inGet started
Tessl Logo

optimizing-attention-flash

Optimizes transformer attention with Flash Attention for 2-4x speedup and 10-20x memory reduction. Use when training/running transformers with long sequences (>512 tokens), encountering GPU memory issues with attention, or need faster inference. Supports PyTorch native SDPA, flash-attn library, H100 FP8, and sliding window attention.

71

Quality

88%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

77%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The content is highly actionable with executable code and well-sequenced, validation-backed workflows. It loses points for broken/dead reference links (two referenced files are missing) and minor explanatory padding.

Suggestions

Create the missing references/algorithm.md and references/advanced-features.md files, or remove the two dead 'See references/...' links so navigation is not broken.

Trim obvious commentary comments (e.g. '# Automatically uses Flash Attention if available', '# Should be ≥2.2.0') that restate what the code already shows, to improve token efficiency.

Verify the flash_attn_func FP8 call signature against current flash-attn docs, since passing float8 tensors directly may not be the supported API.

DimensionReasoningScore

Conciseness

Mostly efficient and code-forward, but includes some explanatory padding a competent model already knows (e.g., '# Automatically uses Flash Attention if available', explanatory 'Before/After' comments, 'Result: ~1.2 PFLOPS') that could be tightened; no basic-concept lecturing, so it clears the bar above 1.

2 / 3

Actionability

Provides fully executable, copy-paste-ready code and bash commands throughout (SDPA calls, flash_attn_func invocations, install commands, benchmark harness), matching the 'copy-paste ready' anchor.

3 / 3

Workflow Clarity

Each workflow has an explicit numbered checklist plus per-step breakdowns, and Step 4 ('Test accuracy matches baseline', max-diff check) acts as a validation checkpoint with a feedback loop, matching the clear-sequence-with-validation anchor.

3 / 3

Progressive Disclosure

The body signals one-level-deep references, but two of the four referenced files (references/algorithm.md and references/advanced-features.md) do not exist in the bundle, and only benchmarks.md and transformers-integration.md are present, so navigation is partly broken and organization is imperfect.

2 / 3

Total

10

/

12

Passed

Description

100%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is concrete, action-oriented, and includes explicit 'Use when' triggers covering natural user phrasings. It clearly defines a distinct niche with specific supported backends and quantified benefits.

DimensionReasoningScore

Specificity

Lists multiple concrete actions ('Optimizes transformer attention', '2-4x speedup', '10-20x memory reduction') and enumerates specific supported backends (PyTorch native SDPA, flash-attn, H100 FP8, sliding window), matching the 'lists multiple specific concrete actions' anchor.

3 / 3

Completeness

Explicitly answers both what ('Optimizes transformer attention with Flash Attention...') and when ('Use when training/running transformers with long sequences...'), satisfying the explicit-trigger anchor for a top score.

3 / 3

Trigger Term Quality

Natural user phrases are well covered: 'training/running transformers with long sequences', 'GPU memory issues with attention', 'need faster inference'. These are terms a user would actually say, with good coverage of variations.

3 / 3

Distinctiveness Conflict Risk

Has a clear niche (Flash Attention / GPU memory / long sequences) with distinct triggers unlikely to fire for unrelated skills, matching the 'clear niche with distinct triggers' anchor.

3 / 3

Total

12

/

12

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

relative_links

Relative link issues: 2 missing

Warning

referenced_paths_exist

Referenced path issues: 4 missing

Warning

Total

13

/

16

Passed

Repository
Orchestra-Research/AI-Research-SKILLs
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.