CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

emerging-techniques-speculative-decoding

Accelerate LLM inference using speculative decoding, Medusa multiple heads, and lookahead decoding techniques. Use when optimizing inference speed (1.5-3.6× speedup), reducing latency for real-time applications, or deploying models with limited compute. Covers draft models, tree-based attention, Jacobi iteration, parallel token generation, and production deployment strategies.

Quality

79%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Low

Low-risk findings worth noting

Fix and improve this skill with Tessl

tessl review fix ./cli-tool/components/skills/ai-research/emerging-techniques-speculative-decoding/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

63%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The content is highly actionable with concrete quick-start code, install commands, and useful decision guidance for choosing among the three techniques. Its main weaknesses are token inefficiency from duplicating reference-file material inline, a broken reference to a missing draft_model.md, and absent verification/benchmarking steps.

Suggestions

Create the missing references/draft_model.md or remove it from the See Also section, since the cited file does not exist in the bundle.

Trim the Core Concepts sections to brief summaries and delegate Medusa architecture and tree-attention detail (including the duplicated diagrams) to references/medusa.md and references/lookahead.md.

Add a benchmarking/verification step (e.g., measuring tokens/sec before and after enabling each method) so users can confirm the claimed 1.5-3.6x speedups, and fix the minor code gaps (missing imports, undefined dataloader and F in the Medusa training loop).

DimensionReasoningScore

Conciseness

The Core Concepts sections re-explain Medusa architecture and tree-based attention (including a duplicated ASCII tree diagram) that already live in references/medusa.md, and the speculative_decode / LookaheadDecoding class snippets are illustrative pseudocode, so the body is mostly efficient but includes notable duplication and padding that could be tightened.

3 / 5

Actionability

Quick Start provides concrete, near-copy-paste code for all three methods plus explicit install commands, but there are minor gaps: 'import torch' is missing in the first example, AutoTokenizer is unimported in the Medusa example, and the Medusa-heads training loop references undefined 'dataloader' and 'F'.

4 / 5

Workflow Clarity

The body follows a clear progression (When to Use → Installation → Quick Start → Comparison → Best Practices → Production) with explicit decision logic ('Choose the Right Method', the Method Comparison table, and hyperparameter defaults), but it lacks a benchmarking/verification step to confirm claimed speedups, leaving most rather than all checkpoints present.

4 / 5

Progressive Disclosure

The 'See Also' section clearly signals one-level-deep references, but the cited references/draft_model.md does not exist in the bundle, and substantial Medusa/Lookahead detail is duplicated inline in Core Concepts instead of being delegated to the existing reference files, so structure is present but organization is flawed.

3 / 5

Total

14

/

20

Passed

Description

88%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

The description is strong: it clearly states what the skill does, provides an explicit 'Use when...' clause with concrete triggers, and covers the technique landscape comprehensively. Keyword coverage is good but misses a few natural synonyms, and the broad optimization framing creates minor overlap risk with adjacent inference-optimization skills.

DimensionReasoningScore

Specificity

The description names concrete actions ('Accelerate LLM inference using speculative decoding, Medusa multiple heads, and lookahead decoding techniques') and comprehensively lists capabilities ('draft models, tree-based attention, Jacobi iteration, parallel token generation, and production deployment strategies'), matching the comprehensive-coverage anchor.

5 / 5

Completeness

It explicitly answers 'what' (accelerates LLM inference via three named techniques) and 'when' with a concrete 'Use when...' clause covering three trigger scenarios, matching the anchor that requires both what and when with concrete trigger phrases.

5 / 5

Trigger Term Quality

Natural trigger phrases like 'optimizing inference speed', 'reducing latency', and 'real-time applications' are present, but common user variations such as 'speed up inference', 'faster generation', or 'throughput' are missing, which fits the good-but-incomplete keyword coverage anchor rather than comprehensive coverage.

4 / 5

Distinctiveness Conflict Risk

The niche (speculative decoding, Medusa, lookahead decoding) has distinct technical triggers, but generic phrases like 'optimizing inference speed' and 'deploying models with limited compute' could overlap with quantization or model-serving skills, placing it at mostly distinct with minor overlap risk rather than minimal conflict risk.

4 / 5

Total

18

/

20

Passed

Validation

87%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 14 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

metadata_field

'metadata' should map string keys to string values

Warning

referenced_paths_exist

Referenced path issues: 1 missing

Warning

Total

14

/

16

Passed

Repository

davila7/claude-code-templates

Path

cli-tool/components/skills/ai-research/emerging-techniques-speculative-decoding/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.