CtrlK
BlogDocsLog inGet started
Tessl Logo

awq-quantization

Activation-aware weight quantization for 4-bit LLM compression with 3x speedup and minimal accuracy loss. Use when deploying large models (7B-70B) on limited GPU memory, when you need faster inference than GPTQ with better accuracy preservation, or for instruction-tuned and multimodal models. MLSys 2024 Best Paper Award winner.

64

Quality

77%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./10-optimization/awq/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

65%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

Highly actionable with executable examples across backends, but the body is verbose and monolithic — it never links to the existing reference files and omits validation checkpoints in the quantization workflow. Tightening inline detail and wiring up the bundle files would lift both conciseness and progressive disclosure.

Suggestions

Reference the existing bundle files from the body — e.g. add a '## Advanced usage' link to references/advanced-usage.md and a '## Troubleshooting' link to references/troubleshooting.md, and move the benchmark tables and per-kernel deep dives into advanced-usage.md.

Add an explicit validation step to the quantize workflow, such as reloading the saved model and checking perplexity/output against the FP16 baseline before declaring success.

Trim conceptual explanation Claude already knows (the 'Key insight' paragraph restating that not all weights are equally important) to reduce token cost.

DimensionReasoningScore

Conciseness

Mostly practical and code-dense, but the ~280-line body front-loads conceptual explanation Claude already knows (e.g. 'AWQ assumes not all weights are equally important') and inlines extensive benchmark tables and every integration variant, so it could be tightened by offloading detail to the bundle files.

2 / 3

Actionability

Provides copy-paste-ready, fully executable code for loading, quantizing, saving, and serving across AutoAWQ, Transformers, and vLLM, with concrete quant_config values and timing figures.

3 / 3

Workflow Clarity

The 'Quantize your own model' flow is sequenced (load → configure → quantize → save), but it lacks any validation/verification checkpoint for this batch operation, capping the score per the destructive/batch-operations guideline.

2 / 3

Progressive Disclosure

Section organization is decent, but the body is largely monolithic with benchmarks, all kernel backends, and troubleshooting inlined, while the provided bundle files (advanced-usage.md, troubleshooting.md) are never referenced or signaled from SKILL.md.

2 / 3

Total

9

/

12

Passed

Description

90%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description with explicit 'Use when' triggers, good natural keyword coverage, and clear differentiation from sibling quantization methods. The only weakness is that it describes one capability with attached benefits rather than enumerating multiple discrete actions.

DimensionReasoningScore

Specificity

Names the domain ('4-bit LLM compression') and a few concrete outcomes ('3x speedup', 'minimal accuracy loss'), but these are attributes of a single capability rather than a list of multiple distinct user-facing actions, so it does not reach the 'lists multiple specific concrete actions' anchor.

2 / 3

Completeness

Clearly answers both what ('Activation-aware weight quantization for 4-bit LLM compression...') and when via an explicit 'Use when...' clause with multiple concrete triggers.

3 / 3

Trigger Term Quality

Covers natural terms an ML practitioner would say — 'deploying large models (7B-70B) on limited GPU memory', 'faster inference than GPTQ', 'instruction-tuned and multimodal models', '4-bit' — giving good coverage of likely phrasings.

3 / 3

Distinctiveness Conflict Risk

AWQ is a clearly delineated niche explicitly contrasted with GPTQ and bitsandbytes, with distinct triggers tied to GPU memory and inference speed, making misfires unlikely.

3 / 3

Total

11

/

12

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository
Orchestra-Research/AI-Research-SKILLs
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.