CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

litert-model-equivalence-test

Validates equivalence between LiteRT models (litert_lm) and PyTorch models (transformers). Use when you need to verify that an exported LiteRT model produces the same outputs as the original Hugging Face model. Supports multi-turn conversations and custom prompts.

Quality

85%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

86%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A lean, highly actionable skill body: every command is executable as written, examples cover the realistic usage variants, and the structure is clean with no bundle sprawl. The only notable gaps are repeated boilerplate in the examples and the absence of any guidance on interpreting the test's output.

DimensionReasoningScore

Conciseness

The body is efficient: the Flags section documents defaults without explaining known concepts, and no background padding is present. Minor redundancy — the full three-line bazel target is repeated verbatim six times and the bracketed flags in the usage block duplicate the Flags section — keeps it at anchor 4 rather than anchor 5.

4 / 5

Actionability

Fully executable, copy-paste-ready bazel commands are given with a concrete model ID (google/gemma-3-270m-it), and five examples cover the common cases (single-turn, multi-turn, prompt file, externalized embedder, NPU backend). This matches anchor 5.

5 / 5

Workflow Clarity

The single action (invoke the equivalence_test target with documented flags) is unambiguous, but the body never states what the test outputs or what equivalence success/failure looks like — a minor validation/interpretation gap matching anchor 4. It is not anchor 5 because no explicit checkpoint or result-interpretation guidance exists, and not anchor 3 because the invocation itself is fully specified.

4 / 5

Progressive Disclosure

No bundle files exist or are referenced, and none are needed: the body is a well-organized single file with clear sections (Usage, Running the Test, Flags, Examples) and easy navigation. Per the simple-skill guidance, well-organized single-file structure with no need for external references matches the top anchor.

5 / 5

Total

18

/

20

Passed

Description

78%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description with a clear, concrete statement of what the skill does and an explicit 'Use when' trigger clause anchored to specific technologies. Trigger keywords are specific and natural for the LiteRT export domain, though synonym coverage and trigger-scenario breadth could be expanded.

Suggestions

Broaden the 'when' clause with additional concrete trigger scenarios, e.g., 'Use when exporting or converting Hugging Face models to LiteRT, or when verifying an exported LiteRT model matches its PyTorch source.'

Add natural synonyms users might say, such as 'compare outputs', 'model parity', or 'export validation', to improve trigger term coverage.

Name one or two more concrete capabilities (e.g., configurable generation length, KV cache settings, CPU/NPU backend selection) to raise specificity toward comprehensive coverage.

DimensionReasoningScore

Specificity

"Validates equivalence between LiteRT models (litert_lm) and PyTorch models (transformers)" and "Supports multi-turn conversations and custom prompts" list several concrete, named capabilities. Minor gaps in coverage keep it at anchor 4 rather than the comprehensive action list of anchor 5.

4 / 5

Completeness

Both parts are present: a clear what ("Validates equivalence between LiteRT models and PyTorch models") and an explicit when ("Use when you need to verify that an exported LiteRT model produces the same outputs as the original Hugging Face model"). The when-clause covers only a single trigger scenario rather than the multiple concrete trigger phrases of anchor 5, so it sits at anchor 4.

4 / 5

Trigger Term Quality

Terms like "LiteRT", "PyTorch", "Hugging Face", "exported", and "equivalence" are natural phrases for this domain and would match real user requests. A few natural synonyms (e.g., "compare outputs", "model parity", "export validation") are missing, matching anchor 4 rather than the full synonym coverage of anchor 5.

4 / 5

Distinctiveness Conflict Risk

"Validates equivalence between LiteRT models (litert_lm) and PyTorch models (transformers)" carves out a clear niche with distinct, technology-specific triggers; it is unlikely to fire for any unrelated skill. This matches anchor 5 (clear niche, minimal conflict risk).

5 / 5

Total

17

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

google-ai-edge/litert-torch

Path

litert_torch/generative/export_hf/experimental/validation/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.