CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

long-context

Extend context windows of transformer models using RoPE, YaRN, ALiBi, and position interpolation techniques. Use when processing long documents (32k-128k+ tokens), extending pre-trained models beyond original context limits, or implementing efficient positional encodings. Covers rotary embeddings, attention biases, interpolation methods, and extrapolation strategies for LLMs.

60

Quality

76%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

Fix and improve this skill with Tessl

tessl review fix ./skills/emerging-techniques/long-context/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

57%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body delivers strong actionable material — complete RoPE and ALiBi implementations, concrete HuggingFace rope_scaling configurations, real model IDs, a useful method-comparison table, and deployment configs — but it over-explains theory Claude already knows and duplicates the content of its own three reference files rather than summarizing and pointing to them. Workflow guidance is topical rather than sequential, with no validation step before production deployment. Restructuring around the existing reference files would resolve most weaknesses.

Suggestions

Replace the Core Concepts section with the method-comparison table plus one-line summaries, and point to references/rope.md and references/extension_methods.md for theory, math, and parameter details instead of re-explaining them inline.

Frame an explicit sequenced workflow — choose method (comparison table) → set rope_scaling config → fine-tune → validate on a long-document eval (e.g., perplexity or needle-in-haystack check) → deploy — so the implicit section order becomes a checkable procedure.

Link each topical section to its matching reference file inline (e.g., the fine-tuning section → references/fine_tuning.md) and trim the duplicated inline detail, removing filler pseudo-code like "use_method = \"ALiBi\"" and the fabricated "steps_needed = 100 * scaling_factor" estimate.

DimensionReasoningScore

Conciseness

The body is mostly actionable (installation, code, configs, a method-comparison table, deployment), but the ~90-line "Core Concepts" section re-explains RoPE/ALiBi/YaRN theory Claude already knows ("Encodes absolute position via rotation matrix", "11% faster training vs sinusoidal embeddings") and duplicates references/rope.md and references/extension_methods.md; the fine-tuning section likewise duplicates references/fine_tuning.md, and Best Practices contains filler pseudo-code ("use_method = \"ALiBi\"", "steps_needed = 100 * scaling_factor # Rough estimate"). It is not 2 because the majority of the content is genuinely useful and non-inferable (HF rope_scaling configs, model IDs, comparison table), not heavily padded; not 4 because the redundant theory and cross-file duplication is more than a minor trim.

3 / 5

Actionability

Mostly executable guidance: a complete working RotaryEmbedding implementation, ALiBi slope/bias code, concrete rope_scaling config dicts, full TrainingArguments, a fine-tuning CLI command, and vLLM deployment settings with real model IDs. It falls short of anchor 5 due to placeholders and pseudo-code — "fine_tune(model, long_documents, steps=1000)", "scale_to_1M_tokens()", the undefined "long_document_dataset", and Quick Start usage referencing undefined "query"/"key" tensors — and the misleading claim that position interpolation "works out-of-the-box after this config change", which the later pitfalls section contradicts.

4 / 5

Workflow Clarity

A rough topical sequence is present (installation → quick start → method choice via comparison table → fine-tuning → production deployment) and the ✅/❌ pitfall contrasts give error-avoidance guidance, but there is no explicit step sequence and validation is absent: no checkpoint verifying the extended context actually works (e.g., perplexity or long-document eval) before deployment, and no validate-fix-retry loop. The sequence is present but checkpoints are missing or implicit, matching anchor 3; anchor 4 would require most checkpoints to be explicit. The destructive/batch cap does not apply as this is a technique reference, not a batch operation.

3 / 5

Progressive Disclosure

Three real, one-level-deep reference files exist and are clearly listed with descriptions in the "See Also" section ("references/rope.md - Detailed RoPE implementation and theory", etc.), and section headers organize the body. However, content that should live in those files is duplicated inline — Core Concepts re-summarizes rope.md and extension_methods.md theory (including math formulations and parameter lists), and the fine-tuning sections duplicate fine_tuning.md — and the topical sections never link to their corresponding reference file inline, only in a terminal See Also. This fits anchor 3 ("content that should be separate is inline") better than anchor 4, where organization gaps would be minor.

3 / 5

Total

13

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it explicitly states concrete capabilities across all four major context-extension techniques and pairs them with a specific 'Use when...' trigger clause covering document lengths, model extension, and positional-encoding implementation. The only weaknesses are a few missing natural synonyms ("long context", "context length") and slight breadth in the positional-encoding trigger that could cause minor overlap with general transformer skills.

DimensionReasoningScore

Specificity

The description lists multiple concrete actions — "Extend context windows of transformer models using RoPE, YaRN, ALiBi, and position interpolation techniques", "processing long documents (32k-128k+ tokens)", "extending pre-trained models beyond original context limits", "implementing efficient positional encodings" — naming four specific techniques with comprehensive domain coverage. It is not 4 because coverage extends across all major techniques of the domain rather than having gaps.

5 / 5

Completeness

Both questions are explicitly answered: the "what" in "Extend context windows of transformer models using RoPE, YaRN, ALiBi, and position interpolation techniques" and the "when" in "Use when processing long documents (32k-128k+ tokens), extending pre-trained models beyond original context limits, or implementing efficient positional encodings" — a concrete 'Use when...' clause with specific trigger scenarios, matching the anchor-5 example structure.

5 / 5

Trigger Term Quality

Good natural keywords: "context windows", "long documents", "32k-128k+ tokens", "RoPE", "YaRN", "ALiBi", "position interpolation", "positional encodings", "pre-trained models" — terms a user with this need would plausibly say. It falls short of anchor 5 because common phrasings like "long context", "context length", or "extend context" are absent; it exceeds anchor 3 because keyword coverage is broad, including the technique synonyms "rotary embeddings" for RoPE.

4 / 5

Distinctiveness Conflict Risk

Technique names ("RoPE", "YaRN", "ALiBi", "position interpolation") and "32k-128k+ tokens" form a clear niche with distinct triggers, but "implementing efficient positional encodings" and "extrapolation strategies for LLMs" are broad enough to overlap with a general transformer-training or attention-implementation skill. Minor overlap risk with closely related skills fits anchor 4; anchor 5 would require all triggers to be as unambiguous as the technique names.

4 / 5

Total

18

/

20

Passed

Validation

81%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 13 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

skill_md_line_count

SKILL.md is long (537 lines); consider splitting into references/ and linking

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

referenced_paths_exist

Referenced path issues: 1 missing

Warning

Total

13

/

16

Passed

Repository

OpenLAIR/dr-claw

Path

skills/emerging-techniques/long-context/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.