CtrlK
BlogDocsLog inGet started
Tessl Logo
SkillPublic

skypilot-multi-cloud-orchestration

Multi-cloud orchestration for ML workloads with automatic cost optimization. Use when you need to run training or batch jobs across multiple clouds, leverage spot instances with auto-recovery, or optimize GPU costs across providers. Also covers Lambda Labs (guides in references/).

Quality

78%

Does it follow best practices?

Run evals on this skill

Adds up to 20 points to the overall score

View guide
SecuritybySnyk

Passed

No findings from the security scan

Fix and improve this skill with Tessl

tessl review fix ./skills/infrastructure/skypilot/SKILL.md
SKILL.md
Quality
Evals
Security

Quality

Content

72%Weight 40%Scale 1-5

Reviews the quality of instructions and guidance provided to agents. Good implementation is clear, handles edge cases, and produces reliable results.

The body is highly actionable — dense, executable YAML and CLI examples that cover the main SkyPilot workflows — and prose is lean. The weaknesses are structural: destructive/batch operations (cluster teardown, the sweep loop) proceed without validation checkpoints, much of the configuration detail should live in reference files rather than inline, and the merged Lambda Labs sub-bundle introduces two-level reference nesting.

Suggestions

Add explicit validation checkpoints around destructive and batch operations, e.g. run 'sky status' to confirm the target cluster before 'sky down', and check 'sky jobs queue' after the sweep loop to verify all 10 jobs launched successfully.

Move detailed configuration reference material (accelerator lists, storage mode tables, Sky Serve autoscaling policies, distributed-training env vars) into references/ files so SKILL.md stays a lean overview with well-signaled pointers.

Flatten the Lambda Labs sub-bundle's nested references (references/lambda-labs/references/*.md) to a single level so no content sits more than one reference hop from SKILL.md.

DimensionReasoningScore

Conciseness

The body is dominated by copy-paste YAML and CLI blocks with minimal prose padding and no explanation of concepts Claude already knows, matching anchor 4 ('efficient; minor instances of over-explanation'). It is not a 5 because of small redundancies like comments restating the obvious ('# Task name (optional)', '# Optional: auto-select if omitted') and some duplication between the Quick start and Cluster management sections.

4 / 5

Actionability

Nearly every section is executable: a working install-and-verify sequence (pip install, sky check), a complete hello-world YAML with launch/ssh/down commands, full task YAML schemas, and end-to-end workflow examples (fine-tuning with checkpoint mounts, hyperparameter sweep loop) covering the common cases. This matches anchor 5: copy-paste ready commands with specific examples for common use cases.

5 / 5

Workflow Clarity

Sequences are present (install → sky check → create YAML → launch; debugging commands; a common-issues table), but destructive and batch operations lack validation checkpoints — 'sky down hello' terminates clusters with no verify-first step, and the sweep loop launches 10 managed jobs without checking 'sky jobs queue'. The rubric caps workflow clarity at 3 for destructive/batch workflows missing validation, so it cannot score 4 despite the otherwise clear structure.

3 / 5

Progressive Disclosure

The References section clearly signals one-level-deep files (references/advanced-usage.md, references/troubleshooting.md), but roughly 500 lines of detailed configuration reference (GPU accelerator lists, storage mode tables, Sky Serve policies, distributed env vars) are inlined in SKILL.md when they belong in reference files — matching the anchor 3 example of '[200 lines of API reference that could be in a separate file]'. Additionally, the bundled lambda-labs guide nests its own references at two levels deep (references/lambda-labs/overview.md → references/lambda-labs/references/*.md), which the rubric penalizes.

3 / 5

Total

15

/

20

Passed

Description

78%Weight 40%Scale 1-5

Based on the skill's description, can an agent find and select it at the right time? Clear, specific descriptions lead to better discovery.

A strong description with an explicit 'what' and a concrete 'Use when' trigger clause covering the main use cases. The main deductions are the second-person 'you need to' phrasing (penalized under the third-person voice rule) and missing natural synonyms such as specific cloud names. Trigger coverage and completeness are otherwise solid.

Suggestions

Rewrite the trigger clause in third person to avoid the second-person penalty, e.g. 'Use when running training or batch jobs across multiple clouds, leveraging spot instances with auto-recovery, or optimizing GPU costs across providers.'

Add one or two natural synonyms users actually say, such as specific cloud names (AWS, GCP, Azure) or 'cheapest GPU', to broaden trigger-term coverage.

DimensionReasoningScore

Specificity

The description lists several concrete actions ('run training or batch jobs across multiple clouds', 'leverage spot instances with auto-recovery', 'optimize GPU costs across providers'), which matches anchor 4, but the rubric mandates a 1-point reduction for second-person voice and the trigger clause uses 'Use when you need to...', explicitly addressing the user as 'you'. Base 4 minus 1 gives 3; it is not a 2 because the named actions are specific and multi-part rather than minimal or generic.

3 / 5

Completeness

Both questions are answered explicitly: 'what' via 'Multi-cloud orchestration for ML workloads with automatic cost optimization' and 'when' via the concrete trigger clause 'Use when you need to run training or batch jobs across multiple clouds, leverage spot instances with auto-recovery, or optimize GPU costs across providers'. This matches the anchor 5 example pattern of what + explicit 'Use when' with concrete trigger phrases.

5 / 5

Trigger Term Quality

Natural phrases users would say are present ('training', 'batch jobs', 'multiple clouds', 'spot instances', 'GPU costs', 'providers'), giving good keyword coverage. It falls short of anchor 5 because common variations are missing — no specific cloud names (AWS, GCP, Azure), no 'cheap/cheapest GPUs' or 'interruptible instances' style synonyms.

4 / 5

Distinctiveness Conflict Risk

The multi-cloud/spot/GPU-cost niche has distinct triggers and is clearly distinguishable from generic infrastructure skills. It is not a 5 because 'Also covers Lambda Labs' broadens scope and creates overlap risk with a dedicated Lambda Labs skill, and 'orchestration for ML workloads' brushes against adjacent tools (Ray, Modal).

4 / 5

Total

16

/

20

Passed

Validation

75%

Checks the skill against the spec for correct structure and formatting. All validation checks must pass before discovery and implementation can be scored.

Validation — 12 / 16 Passed

Validation for skill structure

CriteriaDescriptionResult

skill_md_line_count

SKILL.md is long (519 lines); consider splitting into references/ and linking

Warning

frontmatter_unknown_keys

Unknown frontmatter key(s) found; consider removing or moving to metadata

Warning

relative_links

Relative link issues: 1 deeper-than-1-level

Warning

referenced_paths_exist

Referenced path issues: 2 deeper-than-1-level

Warning

Total

12

/

16

Passed

Repository

OpenLAIR/dr-claw

Path

skills/infrastructure/skypilot/SKILL.md

Reviewed

Table of Contents

Is this your skill?

If you maintain this skill, you can claim it as your own. Once claimed, you can manage eval scenarios, bundle related skills, attach documentation or rules, and ensure cross-agent compatibility.