CtrlK
BlogDocsLog inGet started
Tessl Logo

awq-quantization

Activation-aware weight quantization for 4-bit LLM compression with 3x speedup and minimal accuracy loss. Use when deploying large models (7B-70B) on limited GPU memory, when you need faster inference than GPTQ with better accuracy preservation, or for instruction-tuned and multimodal models. MLSys 2024 Best Paper Award winner.

68

Quality

82%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide

SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

65%

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

Highly actionable with abundant executable examples, but the body is denser than necessary and underuses the provided reference bundle. Quantization workflows also lack explicit validation steps before relying on the output.

Suggestions

Add a verification checkpoint after quantization (e.g. reload the saved model and run a quick perplexity/sanity check) so the workflow has a validate-then-proceed loop.

Move the benchmark tables, kernel-backend details, and/or comparison content into references/advanced-usage.md and link to it from the body to reduce inline weight.

Link references/troubleshooting.md from the 'Common issues' section so the existing bundle is discoverable instead of duplicating fixes inline.

DimensionReasoningScore

Conciseness

Mostly efficient with executable snippets, but includes conceptual explanation Claude already knows ('AWQ assumes not all weights are equally important...') and detailed benchmark/comparison tables that pad the body without adding actionable instruction.

2 / 3

Actionability

Provides copy-paste-ready, executable code throughout — install commands, load/quantize/save flows, per-backend configs, vLLM and multi-GPU examples — with specific parameter values and timing notes.

3 / 3

Workflow Clarity

The quantize-your-own-model flow is sequenced (load, configure, quantize, save) but lacks validation/verification checkpoints for this batch operation, e.g. confirming the saved model loads or checking perplexity before deployment.

2 / 3

Progressive Disclosure

Bundle files references/advanced-usage.md and references/troubleshooting.md exist but are never linked from the body, while advanced kernel configs, benchmarks, and comparisons remain inline rather than being offloaded to those references.

2 / 3

Total

9

/

12

Passed

Description

100%

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong, specific description with explicit use-when triggers, quantified benefits, and clear differentiation from GPTQ. The trailing 'MLSys 2024 Best Paper Award winner' badge is mildly promotional but does not undermine the otherwise concrete guidance.

DimensionReasoningScore

Specificity

Lists multiple concrete, quantified capabilities — '4-bit LLM compression', '3x speedup', 'minimal accuracy loss', 'deploying large models (7B-70B) on limited GPU memory' — rather than vague language.

3 / 3

Completeness

Answers both what ('Activation-aware weight quantization for 4-bit LLM compression...') and when via an explicit 'Use when deploying large models... when you need faster inference than GPTQ...' trigger clause.

3 / 3

Trigger Term Quality

Covers natural deployment-oriented terms a user would say — '4-bit', 'quantization', 'limited GPU memory', 'faster inference', 'multimodal models' — alongside the GPTQ comparison frame.

3 / 3

Distinctiveness Conflict Risk

Occupies a clear niche (AWQ 4-bit quantization) and explicitly distinguishes itself from GPTQ, making conflict with adjacent skills unlikely.

3 / 3

Total

12

/

12

Passed

Validation

93%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation15 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

Total

15

/

16

Passed

Repository
synthetic-sciences/openscience
Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.