CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

running-openmed-ondevice

Run OpenMed models fully on-device with the MLX (Apple Silicon), CoreML (iOS/macOS), or ONNX/WebGPU (cross-platform/browser) backends, including convert-quantize-run workflows. Use when the user wants to deploy OpenMed at the edge, run NER/de-id on Apple Silicon, target iPhone/iPad/Mac, export to ONNX or WebGPU, quantize a clinical model to int8/4-bit, run with no network, or pick between MLX/CoreML/ONNX. Covers the mlx/coreml/onnx extras, the convert() functions and python -m convert CLIs, quantization, loading a local MLX artifact through analyze_text, OpenMedMLXLanguageModel/generate_text, and the on-device-only PHI guarantee (nothing leaves the host).

Quality

96%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

SKILL.md
Quality
Evals
Security

Quality

Content

90%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

A dense, highly actionable skill: executable commands for all three backends, a backend-selection table, honest edge-case guidance, and validation checkpoints built into the workflow. The only structural refinement available is splitting per-backend detail into reference files and making the failed-recall-gate recovery path explicit.

Suggestions

Add an explicit error-recovery step to the Workflow section: state what to do when the quantized model fails the recall gate (e.g., re-quantize at 8-bit/4-bit→8-bit, or reject the artifact) so the validate→fix→retry loop is complete.

Move the three per-backend quick-starts (and their option detail) into references/mlx.md, references/coreml.md, and references/onnx.md, keeping SKILL.md as the pick-a-backend overview plus one minimal MLX example.

DimensionReasoningScore

Conciseness

Every section is imperative and load-bearing — a backend-selection table, minimal quick starts with full commands, and gotchas that carry non-obvious information ('some ops fall back to CPU; validate latency on a real device'). No concept Claude already knows is explained; nothing reads as padding. Matches the 5 anchor 'every token earns its place'.

5 / 5

Actionability

Commands are copy-paste executable with concrete flags: 'python -m openmed.mlx.convert --model … --output ./mlx_ner --quantize 8', 'pip install "openmed[mlx]"', 'convert(…, compute_units="cpuAndNeuralEngine", compute_precision="float16", quantize="int8")', and 'include_webgpu=True, opset=18'. The only placeholders ('OpenMed/<some-ner-model>', prompt="...") are user-supplied parameters, not missing detail, so this stays at 5 rather than 4's 'minor gaps'.

5 / 5

Workflow Clarity

The Workflow section gives a clear pick → convert → quantize → run → verify sequence with explicit validation checkpoints ('certify recall' via '--eval-suite writes a recall-delta report', 'gate on leakage, not just F1', verify against full precision before shipping). It falls short of the 5 anchor only because there is no explicit error-recovery loop — what to do when the quantized model fails the recall gate is left implicit — while clearly exceeding 3, which requires missing or implicit checkpoints.

4 / 5

Progressive Disclosure

A single well-organized SKILL.md with clean section headers, a comparison table, and a 'Standards & references' section whose links (MLX/Core ML Tools/ONNX/transformers.js docs, 'openmed/mlx/convert.py' source paths) are one level deep and clearly signaled. It is not the 5 anchor because at ~165 lines the three per-backend quick-starts and gotcha lists are inlined where per-backend reference files would keep the overview leaner; it is well above 3, which requires buried references or structureless inline bulk.

4 / 5

Total

18

/

20

Passed

Description

100%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

An exemplary description: third-person, explicit 'what' and 'when', comprehensive natural triggers, and concrete named APIs/CLIs, all while staying tightly scoped to on-device deployment. No changes needed.

DimensionReasoningScore

Specificity

Quotes multiple specific concrete actions: 'Run OpenMed models fully on-device with the MLX …, CoreML …, or ONNX/WebGPU … backends, including convert-quantize-run workflows' plus 'the convert() functions and python -m convert CLIs, quantization, loading a local MLX artifact through analyze_text, OpenMedMLXLanguageModel/generate_text, and the on-device-only PHI guarantee'. Coverage is comprehensive across all three backends with no gaps; this clearly matches the 5 anchor rather than 4, which would require minor coverage gaps.

5 / 5

Completeness

It explicitly answers both: what — 'Run OpenMed models fully on-device with the MLX/CoreML/ONNX backends, including convert-quantize-run workflows' — and when — the explicit 'Use when…' clause with concrete trigger phrases. This is the 5 anchor verbatim in structure; 4 would require the 'when' to be less explicit.

5 / 5

Trigger Term Quality

'Use when the user wants to deploy OpenMed at the edge, run NER/de-id on Apple Silicon, target iPhone/iPad/Mac, export to ONNX or WebGPU, quantize a clinical model to int8/4-bit, run with no network, or pick between MLX/CoreML/ONNX' covers natural phrasings and synonyms comprehensively (edge, on-device, no network, device names, format names, quantization levels). It matches the 5 anchor's 'including synonyms' breadth; nothing common is missing.

5 / 5

Distinctiveness Conflict Risk

The 'fully on-device / at the edge' framing plus backend-specific triggers (Apple Silicon, iPhone/iPad, WebGPU, no network) carve a clear niche distinct from hosted serving, MCP tooling, or model-selection skills. Conflict risk is minimal; it does not fall to 4, which presumes overlap with closely related skills.

5 / 5

Total

20

/

20

Passed

Validation

100%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 16 / 16 Passed

Validation for skill structure

No warnings or errors.

Repository

maziyarpanahi/openmed

Path

skills/running-openmed-ondevice/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.