CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

litert-quantization-calib

Assists the user to calibrate, merge, and statically quantize litert LLM models (such as Gemma 3) in standard open-source (OSS) environments. Use when the user wants to run LLM calibration, merge task JSON results, align KV cache parameters across models, protect sensitive layers in Float32, or run quantized inference testing. Don't use for JAX/PyTorch custom quantization configurations or non-litert models.

Quality

84%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

68%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body delivers dense, domain-specific gotchas and four largely executable command patterns in a well-sequenced order, but it provides no validation checkpoints for a batch pipeline and contains a malformed driver-script invocation. Splitting the gotcha reference material out and adding verify steps after merge and quantize would raise the weakest dimensions.

Suggestions

Add explicit validation checkpoints after each batch stage — e.g. confirm per-task calibration JSONs exist before merging, verify the merged model.tflite.json/aux.tflite.json files before quantizing, and sanity-check quantized inference output before declaring success.

Fix the E2E driver invocation, which is currently malformed ('bash cd litert_torch/generative/... ./run_quantize_and_inference.sh' mixes a cd path into the bash command); show it as two steps or a correct single command.

Trim the redundant opening paragraph (it restates the frontmatter description) and consider moving the six gotchas into a references/ file so SKILL.md stays a lean overview.

DimensionReasoningScore

Conciseness

The gotchas are genuinely non-obvious domain knowledge (BOS token ID 2 corrupting attention states, embedder lookup-table quantization risk, KV scale alignment) rather than concepts Claude already knows, so the body is largely efficient. Minor trimmable padding remains — the opening paragraph restates the description and the horizontal rules add bulk — keeping it below anchor 5.

4 / 5

Actionability

Four complete command blocks with full flag lists and one concrete value ('--stop_token=106' for Gemma 3) are mostly executable, but the placeholder arguments ('{model_path}', '{true_or_false}') and the malformed E2E script invocation ('bash cd litert_torch/... ./run_quantize_and_inference.sh') leave minor gaps that keep it from copy-paste-ready anchor 5.

4 / 5

Workflow Clarity

The calibrate → merge → quantize → inference-test sequence is clearly ordered across the numbered command sections, but there are no validation or verification checkpoints anywhere (e.g. confirming the merged calibration JSON exists before quantizing, or sanity-checking quantized output before testing). Because this is a batch workflow over multi-task calibration directories and model suites, the rubric caps workflow clarity at 3.

3 / 5

Progressive Disclosure

No bundle files exist, and the single-file body is well-organized with clear section headers (triggers, gotchas, command patterns, driver tool) that make navigation easy. It falls short of anchor 5 only because the ~170-line gotcha reference material sits fully inline in SKILL.md when it could be split into a reference file.

4 / 5

Total

15

/

20

Passed

Description

92%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description: it names the niche precisely, enumerates concrete capabilities across the full calibration-to-inference pipeline, provides explicit 'Use when' triggers, and closes with clear anti-triggers. The only gap is a few missing natural trigger synonyms (int8, A8W8/A16W8, TFLite).

DimensionReasoningScore

Specificity

Lists multiple concrete actions — 'calibrate, merge, and statically quantize litert LLM models', 'align KV cache parameters across models', 'protect sensitive layers in Float32', 'run quantized inference testing' — giving comprehensive coverage of the skill's domain. It exceeds anchor 4 because the action list spans the entire workflow rather than having minor gaps.

5 / 5

Completeness

Explicitly answers both questions: what ('Assists the user to calibrate, merge, and statically quantize litert LLM models') and when ('Use when the user wants to run LLM calibration, merge task JSON results, align KV cache parameters...') with concrete trigger phrases and an explicit 'Don't use for' exclusion.

5 / 5

Trigger Term Quality

Natural phrases like 'LLM calibration', 'merge task JSON results', 'KV cache parameters', and 'quantized inference testing' would be said by users needing this skill, plus a named model ('Gemma 3'). A few natural terms are missing (e.g. 'int8', 'A8W8/A16W8', 'TFLite'), keeping it below anchor 5.

4 / 5

Distinctiveness Conflict Risk

A clear niche ('litert LLM models (such as Gemma 3)') with distinct triggers and an explicit negative boundary ('Don't use for JAX/PyTorch custom quantization configurations or non-litert models'), minimizing overlap with other quantization skills.

5 / 5

Total

19

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

google-ai-edge/litert-torch

Path

litert_torch/generative/export_hf/experimental/calib/skills/tflite_quantization_calib/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.