Accelerate LLM inference using speculative decoding, Medusa multiple heads, and lookahead decoding techniques. Use when optimizing inference speed (1.5-3.6× speedup), reducing latency for real-time applications, or deploying models with limited compute. Covers draft models, tree-based attention, Jacobi iteration, parallel token generation, and production deployment strategies.
79%
Does it follow best practices?
Run evals on this skill
Adds up to 20 points to the overall score
Low
Low-risk findings worth noting
Fix and improve this skill with Tessl
tessl review fix ./cli-tool/components/skills/ai-research/emerging-techniques-speculative-decoding/SKILL.mdThe skill fetches instructions or code from an external URL at runtime, and the fetched content directly controls the agent’s prompts or executes code. This dynamic dependency allows the external source to modify the agent’s behavior without any changes to the skill itself.
The skill references GitHub repositories for downloading code during setup (Medusa and LookaheadDecoding), but GitHub is a transporter rather than the publisher; because the repositories belong to third-party accounts (FasterDecoding and hao-ai-lab) without established enterprise or organizational provenance, they represent common/reputable unofficial operational dependencies.
If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.